-- Logs begin at Tue 2022-04-12 15:35:00 UTC, end at Tue 2022-04-12 16:39:46 UTC. -- Apr 12 16:08:55.692510 dv-cinder-837528-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 12 16:08:55.701295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 16:08:55 2022] *** Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: nodename: dv-cinder-837528-1-iscsi Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: machine: x86_64 Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: clock source: unix Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: pcre jit disabled Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: detected number of CPU cores: 4 Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: current working directory: / Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: detected binary path: /usr/bin/uwsgi-core Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: your processes number limit is 47680 Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: your memory page size is 4096 bytes Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: detected max file descriptor number: 2048 Apr 12 16:08:55.703295 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: lock engine: pthread robust mutexes Apr 12 16:08:55.704253 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: thunder lock: enabled Apr 12 16:08:55.704253 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 16:08:55.704253 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 16:08:55.748841 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: Python main interpreter initialized at 0x55edef6019c0 Apr 12 16:08:55.748841 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: python threads support enabled Apr 12 16:08:55.748841 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: your server socket listen backlog is limited to 100 connections Apr 12 16:08:55.748841 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: your mercy for graceful operations on workers is 90 seconds Apr 12 16:08:55.749244 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 16:08:55.749244 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: *** Operational MODE: preforking *** Apr 12 16:08:55.749523 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: *** uWSGI is running in multiple interpreter mode *** Apr 12 16:08:55.749523 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: spawned uWSGI master process (pid: 102811) Apr 12 16:08:55.749750 dv-cinder-837528-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 12 16:08:55.750292 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: spawned uWSGI worker 1 (pid: 102812, cores: 1) Apr 12 16:08:55.750620 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: spawned uWSGI worker 2 (pid: 102813, cores: 1) Apr 12 16:08:55.750781 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 16:08:56.933529 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 16:08:56.935777 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 16:08:57.794127 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 16:08:57.794127 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: from cryptography.utils import int_from_bytes Apr 12 16:08:57.794440 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 16:08:57.794440 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: from cryptography.utils import int_from_bytes Apr 12 16:08:57.794562 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 16:08:57.794562 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: from cryptography.utils import int_from_bytes Apr 12 16:08:57.794670 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 16:08:57.794670 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: from cryptography.utils import int_from_bytes Apr 12 16:09:00.360990 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 16:09:00.361712 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 16:09:00.361800 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 16:09:00.362175 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 16:09:00.362271 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 16:09:00.362362 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 16:09:00.362440 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 16:09:00.362519 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 16:09:00.362805 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.362960 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 16:09:00.363060 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 16:09:00.363140 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.363431 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.363558 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.363754 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.363898 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.364061 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.364151 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.364396 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.364525 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.364692 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.364782 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.365031 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.365171 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.365355 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.365494 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.365631 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.365865 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.365959 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.366294 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.366403 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837528-1-iscsi {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.366559 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.366647 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.366877 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.366965 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.367206 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837528-1-iscsi {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.367300 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.367521 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.367613 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.367826 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.367920 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.368138 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.368230 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.368441 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.368534 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.368745 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.368946 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.369054 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.370172 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.370321 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.370321 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.370501 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.370595 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.370684 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.370808 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.370934 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371015 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371091 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371211 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371306 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371385 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371503 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371641 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371757 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371836 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.371970 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.372156 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.372281 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.372564 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837528-1-iscsi {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.372661 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.372893 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.373026 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.373198 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.373301 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837528-1-iscsi {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.373523 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.373623 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.373900 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.373993 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.374251 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.374354 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.374569 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.374655 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.374895 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.374991 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.375218 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.375311 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.375530 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.375616 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.375856 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.375951 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.376173 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.376270 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.376495 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.376589 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.376816 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.376908 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.377119 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.377205 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.377430 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.377524 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.377731 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.377823 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.378059 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.378148 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.378369 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.378482 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.378674 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.378760 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.378911 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.378994 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.379266 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.379367 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.379492 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.379574 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.379800 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.379883 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.380123 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.380216 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.380388 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.380477 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.380641 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.380751 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.380959 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.381045 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.381288 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.381375 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.381601 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.381697 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.381954 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.382166 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.382248 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.382335 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.382536 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.382634 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.382842 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.382947 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.383150 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.383247 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.383453 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.383546 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.383760 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.383843 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.384081 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.384174 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.384378 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.384473 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.384697 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.384780 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.385003 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.385084 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.385322 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.385412 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.385633 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.385716 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.385954 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.386068 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.386287 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.386371 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.386615 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.386696 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.386925 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.387008 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.387234 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.387318 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.387552 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.387644 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.387868 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.387951 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.388174 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.388265 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.388483 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.388566 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.388789 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.388881 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.389093 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.389175 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.389400 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.389484 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.389721 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.389823 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.389972 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.390126 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.390303 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.390400 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.390608 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.390705 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.390908 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.390991 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.391213 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.391297 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.391517 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.391607 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.391822 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.391912 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.392121 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.392207 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.392424 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.392514 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.392724 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.392807 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.393026 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.393163 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.393328 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.393415 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.393632 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.393726 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.393942 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.394024 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.394271 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.394356 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.394574 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.394655 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.394880 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.394963 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.395185 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.395270 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.395492 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.395594 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.395796 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.395880 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.396101 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.396186 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.396405 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.396502 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.396708 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.396849 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.397091 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.397232 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.397442 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.397588 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.397829 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.397990 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.398164 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.398346 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.398474 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.398659 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.398799 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.398967 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.399108 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.399287 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.399414 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.399596 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.399736 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.399902 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.400045 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.400220 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.400355 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.400523 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.400676 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.400830 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.400978 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.401148 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.401286 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.401455 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.401603 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.401761 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.401911 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.402082 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.402241 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.402389 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.402546 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.402694 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.402852 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.403000 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.403156 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.403294 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.403462 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.403592 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.403765 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.403891 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.404070 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.404206 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.404378 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.404532 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.404695 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.404841 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.405016 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.405149 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.405324 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.405453 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.405634 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.405777 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.405940 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.406136 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.406289 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:09:00.406470 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.406627 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.406814 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.406961 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.407132 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.407308 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.407465 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.407628 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.407797 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.407961 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.408118 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.408294 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.408433 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.408616 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.408747 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.408934 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.409072 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.409252 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.409386 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.409578 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.409700 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.409892 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.410014 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.410231 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.410356 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.410544 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.410675 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.410865 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.411042 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.411184 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.411311 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.411516 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.411633 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.411835 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.411952 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.412154 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.412279 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.412595 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.412685 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.412918 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.413042 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.413237 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.413359 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.413905 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.413996 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.414268 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.414366 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.414583 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.414667 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.414927 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.415009 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.415254 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.415346 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.415573 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.415656 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.415885 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.415967 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.416200 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.416284 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.416511 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.416593 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.416819 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.416909 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.417130 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.417213 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.417447 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.417529 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.417765 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.417857 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.418099 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.418186 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.418427 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.418523 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.418734 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.418871 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.419038 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.419121 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.419346 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.419473 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.419656 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.419750 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.419969 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.420052 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.420290 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.420372 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.420605 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.420696 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.420919 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.421018 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.421230 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.421312 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.421542 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.421627 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.421850 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.421932 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.422178 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.422264 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.422488 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.422667 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.422794 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.422886 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.423105 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.423195 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.423408 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.423499 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.423729 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.423821 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.424038 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.424129 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.424352 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.424443 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.424679 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.424761 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.424983 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.425074 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.425297 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.425387 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.425606 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.425687 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.425915 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.426006 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.426255 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.426351 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.426570 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.426697 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.426878 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.426972 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.427194 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.427277 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.427506 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.427589 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.427819 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.427912 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.428158 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.428295 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.428475 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.428563 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.428810 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.428894 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.429135 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.429219 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.429442 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.429525 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.429749 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.429834 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.430084 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.430183 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.430401 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.430485 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.430715 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.430806 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.431028 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.431111 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.431340 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.431433 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.431658 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.431742 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.431968 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.432065 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.432283 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.432375 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.432611 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.432702 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.432934 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.433022 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.433238 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.433329 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.433564 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.433649 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.433867 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.433964 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.434203 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.434301 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.434514 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.434596 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.434818 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.434900 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.435122 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.435215 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.435429 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.435512 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.435732 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.435815 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.436040 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.436126 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.436343 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.436425 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.436645 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.436741 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.436945 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.437029 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.437254 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.437338 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.437563 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.437653 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.437866 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.437956 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.438194 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.438309 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.438498 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.438581 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.438800 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.438891 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.439106 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.439197 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.439452 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.439550 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.439759 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.439850 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.440088 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.440178 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.440411 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.440504 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.440724 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.440814 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.441040 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.441123 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.441351 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.441450 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.441655 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.441738 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.441963 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.442065 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.442298 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.442397 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.442607 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.442688 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.442914 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.443010 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.443230 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.443321 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.443539 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.443668 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.443944 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.444084 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.444261 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.444421 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.444584 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.444746 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.444897 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.445056 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.445220 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.445377 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.445523 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.445718 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.445837 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.446104 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.446264 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.446394 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.446520 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.446720 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.446836 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.447031 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.447156 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.447348 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.447465 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.447664 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.447781 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.447975 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.448091 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.448282 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.448401 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.448593 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.448709 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.448913 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.449020 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.449222 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.449339 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.449539 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.449648 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.449852 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.449965 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.450206 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.450302 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.450517 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.450608 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.450839 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.450923 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.451144 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.451227 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.451460 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.451551 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.451792 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.451875 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.452130 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.452211 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.452440 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.452535 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.452763 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.452872 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.453064 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.453148 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.453376 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.453468 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.453688 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.453771 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.453999 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.454120 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.454336 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.454432 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.454642 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.454731 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.454946 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.455049 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.455264 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.455363 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.455573 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.455656 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.455881 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.455963 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.456182 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.456266 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.456484 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.456567 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.456794 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.456885 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.457101 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.457189 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.457405 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.457487 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.457710 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.457794 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.458020 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.458180 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.458353 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.458451 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.458661 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.458745 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.458982 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.459065 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.459310 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.459417 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.459621 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.459735 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.459935 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.460017 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.460248 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.460330 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.460554 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.460644 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.460858 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.460941 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.461162 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.461255 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.461472 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.461568 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.461799 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.461947 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.462149 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.462236 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.462428 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.462525 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.462760 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.462889 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.463058 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.463148 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.463374 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.463466 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.463686 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.463776 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.463999 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.464097 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.464325 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.464410 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.464641 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.464728 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.464954 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.465036 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.465266 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.465351 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.465575 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.465658 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.465884 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.465967 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.466221 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.466308 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.466534 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.466617 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.466846 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.466942 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.467156 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.467246 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.467462 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.467546 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.467767 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.467860 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.468068 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.468151 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.468377 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.468468 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.468696 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.468953 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.469264 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.469348 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.469585 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.469667 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.469909 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.470005 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.470256 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.470343 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.470581 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.470665 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.470911 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.470999 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.471237 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.471320 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.471584 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.471673 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.471890 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.471986 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.472202 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.472312 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.472512 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.472606 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.472818 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.472902 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.473130 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.473230 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.473432 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.473524 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.473735 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.473820 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.474054 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.474197 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.474373 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.474458 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.474678 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.474770 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.475087 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.475180 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.475399 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.475482 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.475707 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.475798 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.476023 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.476109 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.476328 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.476418 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.476637 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.476722 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.476941 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.477025 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.477263 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.477354 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.477572 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.477664 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.477874 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.477957 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.478201 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.478287 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.478504 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.478602 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.478807 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.478913 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.479138 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.479221 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.479443 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.479538 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.479786 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.479870 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.480116 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.480199 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.480420 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.480511 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.480725 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.480816 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.481045 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.481133 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.481346 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.481430 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.481651 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.481735 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.481954 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.482054 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.482291 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.482376 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.482598 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.482680 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.482898 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.483005 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.483198 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.483290 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.483504 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.483586 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.483808 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.483898 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.484116 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.484209 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.484422 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.484520 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.484722 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.484816 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.485022 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.485113 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.485320 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.485416 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.485635 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.485728 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.485937 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.486018 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.486262 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.486345 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.486566 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.486663 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.486877 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.486984 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.487176 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.487297 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.487477 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.487573 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.487780 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.487862 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.488079 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.488160 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.488395 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.488478 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.488695 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.488777 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.488997 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.489090 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.489299 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.489392 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.489606 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.489689 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.489911 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.489994 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.490234 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.490326 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.490600 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.490690 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.490912 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.491005 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.491215 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.491306 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.491516 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.491599 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.491827 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.491920 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.492130 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.492214 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.492431 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.492515 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.492738 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.492832 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.493058 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.493180 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.493360 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.493457 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.493660 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.493751 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.493961 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.494091 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.494289 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.494414 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.494592 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.494685 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.494895 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.494984 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.495196 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.495278 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.495495 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.495584 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.495799 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.495891 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.496097 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.496179 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.496395 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.496478 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.496699 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.496783 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.497009 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.497094 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.497315 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.497449 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.497613 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.497695 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.497914 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.497996 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.498239 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.498333 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.498578 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.498659 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.498878 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.498969 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.499231 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.499313 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.499537 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.499619 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.499853 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.499945 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.500163 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.500247 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.500475 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.500556 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.500780 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.500876 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.501088 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.501177 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.501388 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.501469 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.501702 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.501794 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.502009 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.502112 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.502337 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.502419 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.502645 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.502737 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.502952 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.503042 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.503267 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.503350 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.503573 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.503656 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.503882 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.503965 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.504205 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.504287 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.504521 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.504604 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.504824 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.504905 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.505131 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.505214 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.505442 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.505527 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.505751 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.505832 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.506080 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.506214 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.506468 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.506558 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.506784 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.506858 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.507097 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.507189 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.507403 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.507531 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.507714 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.507798 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.508024 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.508117 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.508334 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.508425 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.508636 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.508718 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.508947 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.509039 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.509254 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.509336 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.509558 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.509640 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.509880 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.509971 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.510212 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.510296 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.510518 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.510601 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.510823 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.510907 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.511125 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.511206 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.511429 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.511510 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.511731 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.511875 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.512156 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.512247 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.512470 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.512553 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.512782 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.512867 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.513084 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.513175 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.513398 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.513490 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.513709 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.513793 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.514032 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.514142 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.514360 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.514456 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.514667 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.514779 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.515094 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.515179 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.515404 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.515500 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.515716 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.515805 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.516020 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.516103 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.516323 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.516414 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.516628 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.516711 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.516938 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.517028 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.517247 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.517330 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.517553 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.517641 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.517864 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.517947 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.518190 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.518276 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.518510 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.518592 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.518824 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.518947 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.519135 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.519241 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.519550 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.519649 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.519855 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.519937 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.520160 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.520258 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.520573 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.520662 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.520885 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.520983 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.521195 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.521277 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.521515 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.521598 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.521892 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.522031 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.522221 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.522306 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.522599 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.522692 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.522914 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.523005 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.523227 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.523321 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.523560 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.523702 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.523883 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.523973 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.524201 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.524300 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.524529 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.524626 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.524838 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.524942 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.525165 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.525267 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.525489 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.525577 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.525807 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.525893 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.526152 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.526242 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.526561 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.526645 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.526894 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.526978 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.527190 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.527283 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.527514 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.527616 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.527824 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.527924 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.528130 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.528217 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.528433 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.528518 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.528739 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.528834 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.529043 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.529130 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.529349 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.529435 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.529658 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.529753 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.529964 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.530073 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.530300 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.530395 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.530613 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.530708 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.530921 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.531014 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.531232 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.531318 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.531536 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.531630 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.531851 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.531942 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.532154 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.532238 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.532478 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.532575 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.532791 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.532881 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.533112 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.533203 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.533426 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.533525 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.533735 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.533836 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.534064 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.534163 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.534379 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.534471 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.534687 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.534784 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.534992 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.535087 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.535299 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.535392 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.535628 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.535713 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.535936 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.536021 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.536263 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.536349 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.536593 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.536686 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.536910 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.537008 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.537224 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.537414 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.537636 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.537772 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.538105 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.538248 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.538426 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.538914 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.539103 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.539251 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.539434 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.539565 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.539747 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.539877 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.540062 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.540208 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.540378 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.540504 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.540684 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.540814 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.540993 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.541123 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.541301 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.541435 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.541613 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.541741 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.541919 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.542070 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.542252 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.542378 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.542564 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.542701 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.542888 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.543016 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.543196 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.543341 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.543521 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.543652 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.543833 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.543958 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.544154 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.544265 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.544464 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.544573 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.544771 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.544915 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.545115 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.545206 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.545420 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.545546 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.545756 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.545869 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.546094 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.546219 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.546420 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.546552 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.546751 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.546865 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.547064 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.547194 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.547390 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.547517 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.547705 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.547834 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.548021 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.548152 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.548337 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.548467 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.548651 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.548784 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.548966 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.549100 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.549286 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.549417 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.549607 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.549730 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.549922 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.550064 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.550264 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.550384 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.550579 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.550705 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.550900 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.551226 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.551424 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.551555 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.551757 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.551873 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.552077 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.552189 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.552397 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.552494 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.552712 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.552797 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.553096 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.553188 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.553484 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.553578 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.553805 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.553916 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.554150 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.554282 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.554468 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.554618 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.554783 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.554932 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.555112 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.555218 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.555439 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.555553 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.555767 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.555853 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.556086 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.556169 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.556404 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.556490 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.556720 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.556804 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.557034 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.557126 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.557351 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.557454 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.557692 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.557779 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.557999 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.558129 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.558343 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.558437 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.558658 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.558742 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.558973 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.559059 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.559284 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.559368 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.559597 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.559690 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.559909 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.559993 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.560222 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.560306 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.560537 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.560621 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.560848 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.560942 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.561158 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.561241 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.561471 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.561554 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.561786 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.561871 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.562136 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.562225 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.562457 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.562552 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.562775 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.562867 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.563090 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.563175 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.563406 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.563497 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.563721 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.563923 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.564241 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.564331 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.564565 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.564657 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.564896 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.565024 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.565223 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.565315 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.565541 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.565633 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.565859 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.565942 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.566211 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.566309 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.566522 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.566608 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.566829 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.566920 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.567138 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.567220 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.567452 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.567566 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.567759 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.567856 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.568083 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.568205 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.568462 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.568557 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.568782 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.568923 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.569111 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.569223 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.569426 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.569520 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.569838 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.569963 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.570337 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.570440 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.570660 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.570798 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.570989 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.571074 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.571315 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.571409 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.571638 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.571722 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.571949 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.572035 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.572269 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.572361 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.572575 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.572659 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.572882 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.572973 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.573190 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.573274 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.573500 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.573590 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.573808 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.573902 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.574135 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.574222 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.574449 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.574531 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.574761 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.574844 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.575066 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.575150 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.575373 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.575456 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.575676 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.575760 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.575979 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.576064 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.576299 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.576383 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.576605 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.576697 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.576908 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.576990 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.577213 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.577309 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.577521 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.577643 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.577826 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.577929 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.578153 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.578248 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.578456 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.578568 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.578760 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.578853 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.579063 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.579157 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.579364 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.579466 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.579667 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.579759 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.579973 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.580074 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.580275 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.580369 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.580580 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.580671 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.580894 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.580998 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.581237 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.581330 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.581544 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.581645 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.581848 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.581942 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.582178 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.582272 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.582488 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.582602 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.582800 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.582894 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.583128 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.583222 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.583424 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.583525 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.583732 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.583842 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.584081 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.584194 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.584596 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.584747 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.584984 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.585307 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.585405 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.585644 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.585738 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.585979 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.586099 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.586316 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.586417 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.586627 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.586713 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.586940 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.587026 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.587271 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.587360 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.587579 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.587671 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.587893 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.587994 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.588206 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.588294 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.588521 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.588606 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.588831 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.588924 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.589142 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.589227 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.589453 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.589536 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.589761 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.589855 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.590093 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.590185 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.590405 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.590508 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.590717 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.590802 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.591028 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.591114 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.591340 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.591427 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.591652 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.591739 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.591968 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.592056 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.592302 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.592387 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.592621 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.592715 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.592939 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.593023 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.593252 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.593345 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.593565 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.593649 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.593874 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.593965 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.594210 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.594309 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.594531 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.594623 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.594861 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.594947 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.595176 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.595274 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.595482 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.595567 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.595807 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.595890 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.596113 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.596208 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.596531 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.596616 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.596841 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.596935 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.597161 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.597246 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.597483 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.597567 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.597799 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.597914 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.598135 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.598259 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.598462 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.598724 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.598873 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.599046 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.599182 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.599379 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.599512 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.599709 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.599840 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.600076 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.600233 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.600399 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.600580 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.600724 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.600868 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.601009 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.601141 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.601297 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.601429 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.601602 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.601741 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.601927 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.602101 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.602272 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.602362 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.602583 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.602691 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.602889 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.602984 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.603194 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.603279 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.603502 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.603595 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.603810 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.603895 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.604116 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.604208 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.604421 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.604567 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.604728 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.604820 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.605037 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.605123 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.605340 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.605476 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.605644 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.605729 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.605946 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.606076 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.606278 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.606364 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.606580 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.606664 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.606887 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.606980 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.607192 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.607278 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.607494 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.607578 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.607801 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.607937 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.608107 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.608195 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.608411 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.608495 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.608711 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.608794 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.609044 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.609132 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.609378 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.609477 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.609702 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.609801 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.610018 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.610127 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.610371 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.610458 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.610684 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.610784 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.611010 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.611096 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.611336 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.611423 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.611654 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.611756 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.611967 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.612053 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.612302 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.612397 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.612618 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.612827 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.612951 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.613037 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.613236 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.613322 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.613558 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.613645 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.613872 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.613965 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.614213 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.614313 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.614530 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.614658 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.614859 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.614946 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.615168 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.615254 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.615518 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.615672 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.615842 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.615933 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.616178 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.616331 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.616502 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.616662 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.616819 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.616987 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.617154 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.617302 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.617473 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.617636 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.617793 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.617944 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.618145 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.618282 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.618462 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.618606 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.618778 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.618921 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.619103 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.619243 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.619424 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.619564 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.619756 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.619894 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.620089 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.620224 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.620430 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.620556 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.620752 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.620884 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.621103 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.621198 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.621421 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.621549 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.621770 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.621865 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.622132 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.622223 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.622458 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.622545 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.622773 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.622869 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.623087 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.623172 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.623333 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 16:09:00.623465 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:09:00.623715 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 16:09:00.646878 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG oslo_db.sqlalchemy.engines [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:09:00.647944 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:09:00.709089 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.context [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a95edbfc-1ac9-4e2d-aad7-de147f566f45(cell1) {{(pid=102812) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 16:09:00.710291 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.context [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a95edbfc-1ac9-4e2d-aad7-de147f566f45(cell1) {{(pid=102813) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 16:09:00.715087 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG oslo_concurrency.lockutils [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:09:00.716270 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:09:00.716727 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG oslo_concurrency.lockutils [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:09:00.717550 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG oslo_concurrency.lockutils [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:09:00.717894 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:09:00.718744 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:09:00.719510 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG oslo_concurrency.lockutils [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:09:00.720695 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:09:00.730971 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG oslo_db.sqlalchemy.engines [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:09:00.733955 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:09:00.739302 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:09:00.739824 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG oslo_db.sqlalchemy.engines [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:09:00.895181 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG oslo_db.sqlalchemy.engines [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:09:00.899861 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:09:01.359037 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: WARNING keystonemiddleware.auth_token [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 16:09:01.359660 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: WARNING keystonemiddleware.auth_token [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 16:09:01.365853 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: WARNING keystonemiddleware.auth_token [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 16:09:01.366521 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: WARNING keystonemiddleware.auth_token [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 16:09:01.585473 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: WARNING keystonemiddleware.auth_token [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 16:09:01.587315 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: WARNING keystonemiddleware.auth_token [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 16:09:01.590596 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: WARNING keystonemiddleware.auth_token [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 16:09:01.592579 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: WARNING keystonemiddleware.auth_token [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 16:09:01.595932 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55edef6019c0 pid: 102813 (default app) Apr 12 16:09:01.597715 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55edef6019c0 pid: 102812 (default app) Apr 12 16:09:01.598069 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:01.599221 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-4eb471d4-1df5-44c3-93b9-678689cf39ef None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Apr 12 16:09:01.599625 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Tue Apr 12 16:09:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:22.031569 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:22.032777 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Apr 12 16:10:22.033174 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:22.501050 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-07611e7e-516b-4bcb-8d1e-58bf00273120 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:22.531960 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-07611e7e-516b-4bcb-8d1e-58bf00273120 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490946 Apr 12 16:10:22.532919 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 2/3] 10.222.0.67 () {60 vars in 1291 bytes} [Tue Apr 12 16:10:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:24.926151 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:24.927150 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-a24daaea-0895-42e9-a10e-b5efaeac60d8 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Apr 12 16:10:24.927538 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 2/4] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:10:24.988409 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-57449ed5-26e0-4914-b269-c1cd5c6c3f14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:25.006067 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 16:10:25.006067 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: warnings.warn(msg) Apr 12 16:10:25.036191 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-57449ed5-26e0-4914-b269-c1cd5c6c3f14 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102619 Apr 12 16:10:25.037182 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 3/5] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 16:10:25.265280 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-365657c5-ca66-430b-9ab8-7a5317f0b6c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:25.267940 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 16:10:25.267940 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: warnings.warn(msg) Apr 12 16:10:25.318161 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-365657c5-ca66-430b-9ab8-7a5317f0b6c0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.271774 Apr 12 16:10:25.332946 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 3/6] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Apr 12 16:10:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:10:27.669578 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-57449ed5-26e0-4914-b269-c1cd5c6c3f14 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:27.670731 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-57449ed5-26e0-4914-b269-c1cd5c6c3f14 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Apr 12 16:10:27.671406 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 4/7] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:27.782000 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-cb95e46c-44ba-4cfa-afdf-8bed37015c8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:27.799638 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 16:10:27.799638 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: warnings.warn(msg) Apr 12 16:10:27.822536 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-cb95e46c-44ba-4cfa-afdf-8bed37015c8c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144456 Apr 12 16:10:27.823319 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 4/8] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:10:27.837092 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-3e6a6f81-106e-4f96-a7fd-f124e87a7808 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:27.840402 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 16:10:27.840402 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: warnings.warn(msg) Apr 12 16:10:27.887319 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-3e6a6f81-106e-4f96-a7fd-f124e87a7808 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054258 Apr 12 16:10:27.888345 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 5/9] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Apr 12 16:10:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:30.256742 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-cb95e46c-44ba-4cfa-afdf-8bed37015c8c admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:30.257788 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-cb95e46c-44ba-4cfa-afdf-8bed37015c8c admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Apr 12 16:10:30.258404 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:30.321735 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-31a2d997-1af6-4286-8b7b-7e9e7973c112 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:30.341951 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-31a2d997-1af6-4286-8b7b-7e9e7973c112 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077641 Apr 12 16:10:30.342647 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 6/11] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:10:30.355219 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-455c092e-8cb4-4593-a548-0a0c6d863ce2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:30.379501 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-455c092e-8cb4-4593-a548-0a0c6d863ce2 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028238 Apr 12 16:10:30.380160 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 6/12] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Apr 12 16:10:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:32.739770 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-31a2d997-1af6-4286-8b7b-7e9e7973c112 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:32.740796 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-31a2d997-1af6-4286-8b7b-7e9e7973c112 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Apr 12 16:10:32.741390 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 7/13] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:32.808574 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-c5fc5b66-a1ff-45f8-bbcd-cf21c0f757d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "ram": 2048}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:32.828348 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-c5fc5b66-a1ff-45f8-bbcd-cf21c0f757d5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080356 Apr 12 16:10:32.828927 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 7/14] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:10:32.841229 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-70a339bc-1c26-4aae-8e5e-f8a361256dbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:32.866134 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-70a339bc-1c26-4aae-8e5e-f8a361256dbb admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028618 Apr 12 16:10:32.866748 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 8/15] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Apr 12 16:10:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:10:35.225668 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-c5fc5b66-a1ff-45f8-bbcd-cf21c0f757d5 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:35.226753 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-c5fc5b66-a1ff-45f8-bbcd-cf21c0f757d5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Apr 12 16:10:35.227254 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 8/16] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:35.295685 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ea50e9a9-8831-42f4-ac88-19d3a6eece70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "id": "d4", "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:35.320661 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ea50e9a9-8831-42f4-ac88-19d3a6eece70 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087204 Apr 12 16:10:35.334370 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-025dfa9c-3341-44fb-be5b-ec902aa80ba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:35.340021 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 9/17] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 16:10:35.360774 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-025dfa9c-3341-44fb-be5b-ec902aa80ba8 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030110 Apr 12 16:10:35.374134 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 9/18] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Apr 12 16:10:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:37.702284 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ea50e9a9-8831-42f4-ac88-19d3a6eece70 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:37.703299 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ea50e9a9-8831-42f4-ac88-19d3a6eece70 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Apr 12 16:10:37.703674 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 10/19] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:37.766875 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-d6c956b8-97a5-4ebb-b602-eab53a945e76 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:37.794751 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-d6c956b8-97a5-4ebb-b602-eab53a945e76 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083334 Apr 12 16:10:37.795691 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 10/20] 10.222.0.67 () {60 vars in 1291 bytes} [Tue Apr 12 16:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:10:40.218127 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ea50e9a9-8831-42f4-ac88-19d3a6eece70 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:40.219240 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ea50e9a9-8831-42f4-ac88-19d3a6eece70 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Apr 12 16:10:40.219659 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 11/21] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:10:40.288143 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-7e220a81-107b-4879-bf14-3aba2dac5bc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "ram": 512}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:40.308189 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-7e220a81-107b-4879-bf14-3aba2dac5bc0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080959 Apr 12 16:10:40.308782 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 11/22] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:10:40.322535 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-fea1a1e5-420f-4f6a-bc8f-35fb4c2cd852 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:40.347260 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-fea1a1e5-420f-4f6a-bc8f-35fb4c2cd852 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028721 Apr 12 16:10:40.347869 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 12/23] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Apr 12 16:10:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:10:42.788054 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-7e220a81-107b-4879-bf14-3aba2dac5bc0 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:42.789419 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-7e220a81-107b-4879-bf14-3aba2dac5bc0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001850 Apr 12 16:10:42.789938 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 12/24] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:42.863138 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-b0d793e6-0fe8-40da-9f74-166532a0d86d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "id": "2", "os-flavor-access:is_public": true}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:42.883129 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-b0d793e6-0fe8-40da-9f74-166532a0d86d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085964 Apr 12 16:10:42.883713 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 13/25] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:10:42.898212 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-4c94da15-f077-49ac-b641-7edb4b93149f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:42.926275 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-4c94da15-f077-49ac-b641-7edb4b93149f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033621 Apr 12 16:10:42.926905 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 13/26] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Apr 12 16:10:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:10:45.517713 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-b0d793e6-0fe8-40da-9f74-166532a0d86d admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:45.518909 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-b0d793e6-0fe8-40da-9f74-166532a0d86d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Apr 12 16:10:45.519281 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 14/27] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:45.591706 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-0dae2ebe-2727-4e98-b31a-211f339fccc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:45.613980 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-0dae2ebe-2727-4e98-b31a-211f339fccc8 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.088179 Apr 12 16:10:45.614584 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 14/28] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:10:45.627221 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-68956b2b-51c7-4644-b5da-fef17f907d54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:45.652758 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-68956b2b-51c7-4644-b5da-fef17f907d54 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029518 Apr 12 16:10:45.653358 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 15/29] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Apr 12 16:10:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:47.999324 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-0dae2ebe-2727-4e98-b31a-211f339fccc8 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:48.000325 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-0dae2ebe-2727-4e98-b31a-211f339fccc8 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Apr 12 16:10:48.000782 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 15/30] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:48.059837 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-cbd06381-f912-4d78-87e4-75654b75aabe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "name": "m1.large"}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:48.078960 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-cbd06381-f912-4d78-87e4-75654b75aabe admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072100 Apr 12 16:10:48.079687 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 16/31] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:10:48.091838 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-e376bd3b-5412-4cb7-8045-2e3cdd5c3db7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:48.116539 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-e376bd3b-5412-4cb7-8045-2e3cdd5c3db7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028483 Apr 12 16:10:48.117129 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 16/32] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Apr 12 16:10:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:10:50.486069 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-cbd06381-f912-4d78-87e4-75654b75aabe admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:50.487202 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-cbd06381-f912-4d78-87e4-75654b75aabe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Apr 12 16:10:50.487752 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 17/33] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:10:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:50.551200 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-acf1da31-c8b7-4ec6-a1ea-93a7bf10f20f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "name": "m1.xlarge", "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:50.571617 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-acf1da31-c8b7-4ec6-a1ea-93a7bf10f20f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077893 Apr 12 16:10:50.572720 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 17/34] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Apr 12 16:10:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 16:10:50.585699 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-a0592bb9-c701-46f8-bd2e-8f33d80bdb42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:50.611749 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-a0592bb9-c701-46f8-bd2e-8f33d80bdb42 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029976 Apr 12 16:10:50.612679 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 18/35] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Apr 12 16:10:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:11:15.753995 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-acf1da31-c8b7-4ec6-a1ea-93a7bf10f20f admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:15.755057 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-acf1da31-c8b7-4ec6-a1ea-93a7bf10f20f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Apr 12 16:11:15.755460 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 18/36] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:11:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:15.829872 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-71e88a70-91ec-4be7-b2f7-af472a4893b9 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:15.847490 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-71e88a70-91ec-4be7-b2f7-af472a4893b9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.084782 Apr 12 16:11:15.848022 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 19/37] 10.222.0.67 () {60 vars in 1291 bytes} [Tue Apr 12 16:11:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:17.248302 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-acf1da31-c8b7-4ec6-a1ea-93a7bf10f20f admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:17.249318 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-acf1da31-c8b7-4ec6-a1ea-93a7bf10f20f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Apr 12 16:11:17.249718 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 19/38] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:17.444775 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-941b4de8-8d67-44d0-9d53-6e4439a04bcb admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:17.450894 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.wsgi [None req-941b4de8-8d67-44d0-9d53-6e4439a04bcb admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 12 16:11:17.451462 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-941b4de8-8d67-44d0-9d53-6e4439a04bcb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:11:17.452260 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-941b4de8-8d67-44d0-9d53-6e4439a04bcb admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064141 Apr 12 16:11:17.452781 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 20/39] 10.222.0.67 () {60 vars in 1190 bytes} [Tue Apr 12 16:11:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 16:11:17.462682 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-6ea8f230-ef59-4db9-98ca-4bdb56fe6336 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:17.483910 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-6ea8f230-ef59-4db9-98ca-4bdb56fe6336 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025196 Apr 12 16:11:17.484425 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 20/40] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Apr 12 16:11:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:17.494494 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-761b6ba7-8e9e-4096-a5de-21ca76a27ed9 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:17.516968 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-761b6ba7-8e9e-4096-a5de-21ca76a27ed9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026458 Apr 12 16:11:17.517501 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 21/41] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Apr 12 16:11:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:17.527735 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-e3616d03-5964-4f64-96ea-b65661b27fd5 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:17.533541 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.wsgi [None req-e3616d03-5964-4f64-96ea-b65661b27fd5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 12 16:11:17.534140 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-e3616d03-5964-4f64-96ea-b65661b27fd5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:11:17.534919 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-e3616d03-5964-4f64-96ea-b65661b27fd5 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011205 Apr 12 16:11:17.535407 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 21/42] 10.222.0.67 () {60 vars in 1190 bytes} [Tue Apr 12 16:11:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 16:11:18.806337 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-761b6ba7-8e9e-4096-a5de-21ca76a27ed9 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:18.807362 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-761b6ba7-8e9e-4096-a5de-21ca76a27ed9 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Apr 12 16:11:18.807780 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 22/43] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:11:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:19.013675 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-6cb7e2ff-ada3-44f2-af63-e538e1fb4f97 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:19.019498 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.wsgi [None req-6cb7e2ff-ada3-44f2-af63-e538e1fb4f97 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 12 16:11:19.020062 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-6cb7e2ff-ada3-44f2-af63-e538e1fb4f97 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:11:19.020875 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-6cb7e2ff-ada3-44f2-af63-e538e1fb4f97 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075567 Apr 12 16:11:19.021394 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 22/44] 10.222.0.67 () {60 vars in 1190 bytes} [Tue Apr 12 16:11:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 16:11:19.034362 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-b40245e4-6ca5-45be-94a7-534fae2159af admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:19.056020 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-b40245e4-6ca5-45be-94a7-534fae2159af admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027325 Apr 12 16:11:19.056570 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 23/45] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Apr 12 16:11:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:19.075038 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-24dbd0c7-4fb9-4a59-ab57-4dd4031ca79b admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:19.094098 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-24dbd0c7-4fb9-4a59-ab57-4dd4031ca79b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027032 Apr 12 16:11:19.094642 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 23/46] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Apr 12 16:11:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:19.107148 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-cf443757-e166-4029-a3ac-1f3b5b1fa679 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:19.115216 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.wsgi [None req-cf443757-e166-4029-a3ac-1f3b5b1fa679 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 12 16:11:19.116111 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-cf443757-e166-4029-a3ac-1f3b5b1fa679 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:11:19.117363 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-cf443757-e166-4029-a3ac-1f3b5b1fa679 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016158 Apr 12 16:11:19.118391 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 24/47] 10.222.0.67 () {60 vars in 1190 bytes} [Tue Apr 12 16:11:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 16:11:20.388779 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-24dbd0c7-4fb9-4a59-ab57-4dd4031ca79b admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:20.389794 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-24dbd0c7-4fb9-4a59-ab57-4dd4031ca79b admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Apr 12 16:11:20.390229 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 24/48] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:11:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:20.593375 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-b368e364-527d-4556-87f9-a1aa035992bd admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:20.599027 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.wsgi [None req-b368e364-527d-4556-87f9-a1aa035992bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 12 16:11:20.599592 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-b368e364-527d-4556-87f9-a1aa035992bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:11:20.600386 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-b368e364-527d-4556-87f9-a1aa035992bd admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.067550 Apr 12 16:11:20.601326 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 25/49] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Apr 12 16:11:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 16:11:20.610551 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-27aed6ac-7e89-4456-9080-75fc5dae16df admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:20.624401 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-27aed6ac-7e89-4456-9080-75fc5dae16df admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017438 Apr 12 16:11:20.624954 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 25/50] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Apr 12 16:11:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:20.635540 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:20.648788 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017472 Apr 12 16:11:20.649360 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 26/51] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Apr 12 16:11:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:20.658676 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-c23e5cff-0f0b-440a-a276-10ea23a1e2f6 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:20.665300 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.wsgi [None req-c23e5cff-0f0b-440a-a276-10ea23a1e2f6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 12 16:11:20.665879 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-c23e5cff-0f0b-440a-a276-10ea23a1e2f6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:11:20.666684 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-c23e5cff-0f0b-440a-a276-10ea23a1e2f6 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011616 Apr 12 16:11:20.667158 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 26/52] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Apr 12 16:11:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 16:11:21.952059 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:21.953506 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Apr 12 16:11:21.954124 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 27/53] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:11:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:22.153016 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-f5c54737-6b45-4178-b9bd-8656f74c5512 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:22.172511 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-f5c54737-6b45-4178-b9bd-8656f74c5512 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.082818 Apr 12 16:11:22.173069 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 27/54] 10.222.0.67 () {64 vars in 1235 bytes} [Tue Apr 12 16:11:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:11:23.435926 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:23.436972 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Apr 12 16:11:23.437370 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 28/55] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:11:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:23.633009 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-76ec195d-6738-4c0d-955a-82d47b7f93a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:23.652953 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-76ec195d-6738-4c0d-955a-82d47b7f93a5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080313 Apr 12 16:11:23.653451 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 28/56] 10.222.0.67 () {64 vars in 1235 bytes} [Tue Apr 12 16:11:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:11:24.961884 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:24.963109 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Apr 12 16:11:24.963529 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 29/57] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:11:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:25.165077 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-8a6281a3-a11e-4613-bd3d-563f70918c4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:25.190929 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-8a6281a3-a11e-4613-bd3d-563f70918c4a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.089250 Apr 12 16:11:25.191548 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 29/58] 10.222.0.67 () {64 vars in 1235 bytes} [Tue Apr 12 16:11:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:11:26.483799 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:26.484823 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Apr 12 16:11:26.485225 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 30/59] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:26.681439 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-95906aab-4b9b-4691-99cf-bb2942bd6d7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:26.704684 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-95906aab-4b9b-4691-99cf-bb2942bd6d7d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.082850 Apr 12 16:11:26.705138 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 30/60] 10.222.0.67 () {64 vars in 1235 bytes} [Tue Apr 12 16:11:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:11:28.001376 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:28.002407 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Apr 12 16:11:28.002831 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 31/61] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:28.202097 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-be0706f8-8764-4f5a-9868-d7e344e26f31 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:28.222199 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-be0706f8-8764-4f5a-9868-d7e344e26f31 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084993 Apr 12 16:11:28.222750 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 31/62] 10.222.0.67 () {60 vars in 1202 bytes} [Tue Apr 12 16:11:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:12:32.586732 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:32.588159 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-ed297ad7-e2f2-4509-a3ad-3163a59482b7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Apr 12 16:12:32.588880 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 32/63] 10.222.0.67 () {54 vars in 930 bytes} [Tue Apr 12 16:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:32.667554 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-526fdd09-0455-4541-98dd-652e92198ed0 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:32.687621 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-526fdd09-0455-4541-98dd-652e92198ed0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.090456 Apr 12 16:12:32.688185 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 32/64] 10.222.0.67 () {60 vars in 1291 bytes} [Tue Apr 12 16:12:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:12:32.716829 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-58ff1df3-3e82-4eec-a226-75631dabc2c2 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:32.725903 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-58ff1df3-3e82-4eec-a226-75631dabc2c2 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013597 Apr 12 16:12:32.726512 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 33/65] 10.222.0.67 () {60 vars in 1282 bytes} [Tue Apr 12 16:12:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:32.738830 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-49a1a8fb-950d-405a-b528-881245736d77 admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:32.746988 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-49a1a8fb-950d-405a-b528-881245736d77 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011837 Apr 12 16:12:32.747513 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 33/66] 10.222.0.67 () {60 vars in 1285 bytes} [Tue Apr 12 16:12:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:12:32.759310 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-4737c627-a7de-44cf-ba25-6ca35c4d4c01 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:32.767671 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-4737c627-a7de-44cf-ba25-6ca35c4d4c01 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012029 Apr 12 16:12:32.768195 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 34/67] 10.222.0.67 () {60 vars in 1285 bytes} [Tue Apr 12 16:12:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:32.779810 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:32.787865 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011870 Apr 12 16:12:32.788420 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 34/68] 10.222.0.67 () {60 vars in 1282 bytes} [Tue Apr 12 16:12:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:22.858419 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-1ee8e2ef-d910-42ac-9844-8ecefe1531ec tempest-verify_tempest_config-414536212 tempest-verify_tempest_config-414536212-project] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:22.863974 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-1ee8e2ef-d910-42ac-9844-8ecefe1531ec tempest-verify_tempest_config-414536212 tempest-verify_tempest_config-414536212-project] 10.222.0.67 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.122634 Apr 12 16:14:22.865420 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 35/69] 10.222.0.67 () {58 vars in 1133 bytes} [Tue Apr 12 16:14:22 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:16:17.806626 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:17.807638 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Apr 12 16:16:17.808033 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 35/70] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:16:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:18.091121 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-55441fbe-381e-4109-bb26-41cfe536459b admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:18.092291 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 16:16:18.092291 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: warnings.warn(msg) Apr 12 16:16:18.093501 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-55441fbe-381e-4109-bb26-41cfe536459b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:16:18.093945 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-55441fbe-381e-4109-bb26-41cfe536459b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:16:18.094783 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-55441fbe-381e-4109-bb26-41cfe536459b admin admin] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:16:18.095210 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-55441fbe-381e-4109-bb26-41cfe536459b admin admin] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:16:18.130557 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-55441fbe-381e-4109-bb26-41cfe536459b admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.177443 Apr 12 16:16:18.130557 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 36/71] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Apr 12 16:16:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:16:19.450166 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:19.451176 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Apr 12 16:16:19.451560 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 36/72] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:16:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:19.653042 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-04d9e61c-7374-4efe-9383-909e6a08fe98 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:19.654249 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 16:16:19.654249 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: warnings.warn(msg) Apr 12 16:16:19.655433 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-04d9e61c-7374-4efe-9383-909e6a08fe98 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:16:19.655952 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-04d9e61c-7374-4efe-9383-909e6a08fe98 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:16:19.656662 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-04d9e61c-7374-4efe-9383-909e6a08fe98 admin admin] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:16:19.657086 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-04d9e61c-7374-4efe-9383-909e6a08fe98 admin admin] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:16:19.675957 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-04d9e61c-7374-4efe-9383-909e6a08fe98 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085145 Apr 12 16:16:19.676504 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 37/73] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Apr 12 16:16:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:16:31.408598 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:31.410067 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Apr 12 16:16:31.410705 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 37/74] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:16:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:31.615080 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-c310a892-f40f-4244-8ce2-eb68cb41ef1f admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:31.616258 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 16:16:31.616258 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: warnings.warn(msg) Apr 12 16:16:31.617437 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-c310a892-f40f-4244-8ce2-eb68cb41ef1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:16:31.617878 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-c310a892-f40f-4244-8ce2-eb68cb41ef1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:16:31.618680 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-c310a892-f40f-4244-8ce2-eb68cb41ef1f admin admin] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:16:31.619106 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-c310a892-f40f-4244-8ce2-eb68cb41ef1f admin admin] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:16:31.643412 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-c310a892-f40f-4244-8ce2-eb68cb41ef1f admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094815 Apr 12 16:16:31.643892 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 38/75] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Apr 12 16:16:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:16:32.991021 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: DEBUG nova.api.openstack.wsgi [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] Calling method '>' {{(pid=102812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:32.992097 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: INFO nova.api.openstack.requestlog [None req-95908cb8-f9dd-40ad-be89-8f6d84ec575e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Apr 12 16:16:32.992487 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: [pid: 102812|app: 0|req: 38/76] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Apr 12 16:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:33.185272 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG nova.api.openstack.wsgi [None req-dcc887e9-a1a2-4ac1-9c2d-2b49370f4054 admin admin] Calling method '>' {{(pid=102813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:33.187079 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 16:16:33.187079 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: warnings.warn(msg) Apr 12 16:16:33.188830 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-dcc887e9-a1a2-4ac1-9c2d-2b49370f4054 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:16:33.189511 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-dcc887e9-a1a2-4ac1-9c2d-2b49370f4054 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:16:33.190793 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-dcc887e9-a1a2-4ac1-9c2d-2b49370f4054 admin admin] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:16:33.191454 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: DEBUG oslo_concurrency.lockutils [None req-dcc887e9-a1a2-4ac1-9c2d-2b49370f4054 admin admin] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:16:33.218386 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: INFO nova.api.openstack.requestlog [None req-dcc887e9-a1a2-4ac1-9c2d-2b49370f4054 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089156 Apr 12 16:16:33.218866 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: [pid: 102813|app: 0|req: 39/77] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Apr 12 16:16:33 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:17:39.793713 dv-cinder-837528-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 12 16:17:39.794451 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: Tue Apr 12 16:17:39 2022 - graceful shutdown triggered... Apr 12 16:17:39.794910 dv-cinder-837528-1-iscsi devstack@n-api.service[102812]: Gracefully killing worker 1 (pid: 102812)... Apr 12 16:17:39.795531 dv-cinder-837528-1-iscsi devstack@n-api.service[102813]: Gracefully killing worker 2 (pid: 102813)... Apr 12 16:17:40.795376 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: worker 1 buried after 1 seconds Apr 12 16:17:40.795376 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: worker 2 buried after 1 seconds Apr 12 16:17:40.795376 dv-cinder-837528-1-iscsi devstack@n-api.service[102811]: goodbye to uWSGI. Apr 12 16:17:40.798122 dv-cinder-837528-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 12 16:17:40.799246 dv-cinder-837528-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 12 16:17:40.803601 dv-cinder-837528-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 12 16:17:40.822466 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 16:17:40 2022] *** Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: nodename: dv-cinder-837528-1-iscsi Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: machine: x86_64 Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: clock source: unix Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: pcre jit disabled Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: detected number of CPU cores: 4 Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: current working directory: / Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: detected binary path: /usr/bin/uwsgi-core Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: your processes number limit is 47680 Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: your memory page size is 4096 bytes Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: detected max file descriptor number: 2048 Apr 12 16:17:40.840836 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: lock engine: pthread robust mutexes Apr 12 16:17:40.841980 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: thunder lock: enabled Apr 12 16:17:40.841980 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 16:17:40.841980 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 16:17:40.888692 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: Python main interpreter initialized at 0x5555ef80a9c0 Apr 12 16:17:40.888692 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: python threads support enabled Apr 12 16:17:40.888692 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: your server socket listen backlog is limited to 100 connections Apr 12 16:17:40.888692 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: your mercy for graceful operations on workers is 90 seconds Apr 12 16:17:40.889172 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 16:17:40.889172 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: *** Operational MODE: preforking *** Apr 12 16:17:40.889395 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: *** uWSGI is running in multiple interpreter mode *** Apr 12 16:17:40.889395 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: spawned uWSGI master process (pid: 117188) Apr 12 16:17:40.889608 dv-cinder-837528-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 12 16:17:40.890226 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: spawned uWSGI worker 1 (pid: 117201, cores: 1) Apr 12 16:17:40.890793 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: spawned uWSGI worker 2 (pid: 117202, cores: 1) Apr 12 16:17:40.891142 dv-cinder-837528-1-iscsi devstack@n-api.service[117188]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 16:17:42.107447 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 16:17:42.117786 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 16:17:43.029385 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 16:17:43.029385 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: from cryptography.utils import int_from_bytes Apr 12 16:17:43.029708 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 16:17:43.029708 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: from cryptography.utils import int_from_bytes Apr 12 16:17:43.030884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 16:17:43.030884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: from cryptography.utils import int_from_bytes Apr 12 16:17:43.031234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 16:17:43.031234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: from cryptography.utils import int_from_bytes Apr 12 16:17:45.394742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 16:17:45.395281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 16:17:45.395465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 16:17:45.395833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 16:17:45.396095 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 16:17:45.396499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.396828 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.397152 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.397475 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.397809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.398182 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.398508 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.398814 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.399146 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.399407 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.399728 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.400053 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837528-1-iscsi {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.400367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 16:17:45.400767 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.400864 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 16:17:45.400948 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.401030 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.401177 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 16:17:45.401333 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.401546 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 16:17:45.401643 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.401807 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 16:17:45.401984 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.402242 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.402350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.402560 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.402824 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.402950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.403193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.404085 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.404294 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.404400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.404486 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.404566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.404702 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.404840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.404989 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405078 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405192 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405329 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405686 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405778 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837528-1-iscsi {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405888 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.405984 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.406154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.406277 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.406617 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837528-1-iscsi {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.406746 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.406955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.407095 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.407266 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.407366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.407632 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.407736 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.407948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.408100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.408441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.408544 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.408765 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.408903 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.409045 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.409135 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.409381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.409525 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.409726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.409830 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.410110 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.410260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.410361 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.410453 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.410695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.410805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.411015 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.411118 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.411318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.411419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.411628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.411736 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.411939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.412041 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837528-1-iscsi {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.412260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.412364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.412565 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.412660 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.412868 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.412972 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.413130 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.413334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.413442 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.413647 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.413751 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.413950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.414079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.414346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.414460 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.414652 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.414747 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.414918 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.415042 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.415214 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.415348 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.415537 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.415657 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.415848 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.415984 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.416218 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.416562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.416685 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.416879 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.416985 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.417185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.417341 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.417509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.417669 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.417832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.417976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.418128 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.418284 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.418389 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.418602 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.418706 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.418927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.419039 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.419269 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.419366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.419614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.419752 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.419999 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.420207 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.420313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.420562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.420669 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.420882 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.420968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.421200 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.421293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.421510 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.421597 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.421847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.422000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.422239 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.422363 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.422541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.422663 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.422867 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.422990 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.423191 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.423313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.423499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.423624 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.423812 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.423946 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.424118 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.424256 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.424426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.424533 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.424763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.424863 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.425070 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.425155 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.425323 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.425476 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.425632 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.425728 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.425959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.426077 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.426326 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.426422 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.426668 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.426850 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.427001 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.427147 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.427314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.427469 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.427622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.427776 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.427930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.428089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.428247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.428393 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.428536 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.428687 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.428850 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.428997 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.429151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.429303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.429447 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.429611 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.430069 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.430245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.430412 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.430566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.430718 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.430868 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.431013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.431186 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.431334 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.431478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.431629 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.431773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.431928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.432083 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.432227 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.432391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.432391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.432682 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.432833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.432977 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.433120 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.433263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.433416 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.433560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.433745 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.433902 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.434076 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.434238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.434399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.434553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.434697 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.434841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.434991 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.435146 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.435291 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.435443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.435594 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.435748 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.435891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.436044 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.436199 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.436342 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.436485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.436637 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.436795 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.436939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.437083 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.437234 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.437391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.437543 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.437815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.437966 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.438203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.438376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.438531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.438684 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.438828 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.438981 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.439134 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.439297 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.439449 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.439601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.439764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.440150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.440310 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.440475 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.440631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.440776 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.440926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.441079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.441304 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.441472 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.441617 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.441617 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.441898 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.442069 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.442230 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.442421 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.442577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.442732 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.442875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.443018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.443171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.443315 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.443465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.443620 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.443772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.443916 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.444068 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.444212 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.444355 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.444517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.444517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.444798 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.444950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.445094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.445236 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.445379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.445530 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 16:17:45.445683 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.445837 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.445988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.445988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.446403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.446570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.446724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.446868 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.447011 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.447153 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.447303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.447448 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.447913 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.448057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.448199 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.448349 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.448502 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.448656 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.448883 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.449042 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.449194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.449194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.449484 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.449628 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.449780 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.449933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.450345 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.450498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.450650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.450803 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.450968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.451123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.451285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.451437 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.451589 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.451733 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.451886 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.452109 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.452267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.452420 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.452576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.452721 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.452884 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.453050 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.453243 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.453395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.453539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.453689 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.453844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.453844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.454156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.454310 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.454462 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.454615 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.454844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.455010 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.455319 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.455491 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.455637 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.455790 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.455934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.456076 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.456220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.456362 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.456513 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.456666 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.456816 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.456968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.457129 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.457275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.457499 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.457654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.457798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.457949 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.458138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.458296 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.458448 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.458602 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.458811 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.458964 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.459132 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.459291 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.459450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.459595 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.459738 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.459880 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.460023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.460194 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.460591 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.460738 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.461940 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.462141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.462300 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.462450 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.462618 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.462764 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.462908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.463052 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.463194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.463347 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.463502 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.463646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.463797 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.464027 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.464173 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.464324 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.464490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.464634 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.464777 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.464928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.465081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.465238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.465391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.465536 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.465679 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.465830 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.465974 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.466156 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.466310 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.466465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.466611 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.466762 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.466924 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.467179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.467350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.467505 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.467658 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.467802 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.467955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.468108 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.468267 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.468419 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.468587 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.468741 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.468974 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.469136 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.469364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.469518 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.469662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.469815 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.469973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.470163 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.470323 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.470720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.470886 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.471052 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.471217 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.471364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.471516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.471661 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.471804 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.471957 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.472115 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.472267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.472418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.472570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.472714 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.472883 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.473028 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.473180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.473324 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.473476 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.473476 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.473764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.473908 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.474071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.474337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.474492 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.474638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.474800 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.474963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.475109 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.475260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.475411 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.475555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.475707 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.475860 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.476003 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.476147 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.476289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.476447 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.476600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.476744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.476906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.477059 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.477393 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.477393 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.477693 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.477836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.478108 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.478264 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.478408 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.478566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.478718 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.478871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.479015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.479170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.479315 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.479475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.479621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.479765 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.479909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.480060 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.480214 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.480359 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.480502 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.480891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.481044 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.481220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.481376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.481520 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.481663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.481663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.481945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.482184 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.482344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.482498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.482649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.482801 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.482943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.483094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.483265 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.483411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.483562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.483706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.483848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.484000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.484144 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.484301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.484496 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.484649 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.484792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.484946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.485098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.485262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.485406 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.485551 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.485701 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.485927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.486091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.486241 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.486398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.486552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.486695 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.486853 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.487006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.487149 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.487312 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.487465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.487617 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.487770 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.487921 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.488072 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.488215 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.488358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.488509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.488662 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.488813 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.488967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.488967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.489266 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.489266 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.489565 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.489719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.489871 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.490023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.490258 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.490412 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.490564 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.490734 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.491285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.491448 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.491617 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.491617 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.491911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.492063 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.492207 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.492350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.492503 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.492648 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.492801 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.492956 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.493108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.493252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.493411 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.493565 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.493710 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.493863 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.494016 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.494182 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.494345 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.494498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.494650 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.494803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.494947 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.495099 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.495258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.495405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.495577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.495721 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.495911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.496086 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.496231 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.496383 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.496535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.496678 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.496828 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.496987 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.497132 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.497276 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.497427 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.497582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.497727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.497884 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.498028 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.498200 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.498343 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.498500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.498645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.498803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.498948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.499107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.499259 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.499402 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.499564 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.499719 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.499871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.500023 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.500268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.500427 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.500581 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.500725 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.500876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.501109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.501445 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.501597 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.501764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.501917 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.502126 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.502279 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.502432 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.502577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.502730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.502875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.503027 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.503179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.503324 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.503475 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.503633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.503790 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.503951 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.504097 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.504249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.504408 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.504553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.504705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.504849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.505000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.505153 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.505321 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.505478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.505623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.505785 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.505937 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.506153 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.506317 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.506463 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.506616 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.506770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.506914 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.507071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.507071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.507344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.507495 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.507647 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.507801 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.507955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.508099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.508251 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.508401 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.508547 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.508689 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.508847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.508992 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.509144 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.509304 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.509465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.509629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.509774 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.509925 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.510100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.510265 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.510411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.510561 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.510706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.510706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.510979 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.510979 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.511490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.511764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.511764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.512065 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.512217 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.512371 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.512522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.512675 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.512829 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.512984 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.513142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.513142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.513432 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.513760 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.514088 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.514419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.514605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.514768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.514931 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.515084 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.515249 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.515409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.515574 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.515780 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.515780 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.516079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.516320 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.516559 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.516749 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.516749 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.517049 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.517214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.517214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.517530 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.517682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.517682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.517982 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.518176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.518330 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.518482 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.518657 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.518824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.518824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.519128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.519281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.519432 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.519629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.519792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.519944 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.520106 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.520265 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.520425 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.520584 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.520748 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.520912 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.521072 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.521234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.521234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.521772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.522139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.522139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.522496 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.522657 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.522818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.522968 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.522968 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.523292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.523451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.523610 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.523768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.523926 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.524087 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.524248 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.524401 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.524552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.524710 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.524861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.525026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.525188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.525348 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.525508 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.525667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.525830 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.525995 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.526180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.526343 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.526496 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.526646 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.526806 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.526967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.527121 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.527283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.527443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.527600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.527765 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.527917 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.528075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.528235 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.528387 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.528537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.528697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.528857 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.529008 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.529163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.529325 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.529476 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.529646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.529797 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.529948 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.530129 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.530293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.530453 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.530616 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.530775 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.530928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.531079 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.531239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.531530 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.531967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.532245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.532411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.532572 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.532734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.532895 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.533055 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.533206 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.533357 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.533507 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.533667 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.533830 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.533994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.534235 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.534235 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.534543 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.534703 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.534865 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.535016 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.535175 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.535326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.535485 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.535651 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.535803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.535965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.536116 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.536275 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.536425 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.536585 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.536744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.536906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.537065 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.537225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.537387 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.537553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.537705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.537856 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.538027 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.538214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.538367 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.538528 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.538691 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.538843 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.539000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.539151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.539310 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.539470 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.539621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.539779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.539930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.540091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.540257 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.540418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.540576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.540734 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.540884 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.541035 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.541203 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.541357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.541508 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.541658 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.541816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.542931 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.543130 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.543287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.543287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.543603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.543763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.543923 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.544084 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.544237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.544387 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.544545 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.544710 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.544942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.545096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.545270 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.545431 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.545596 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.545754 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.545941 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.546360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.546535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.546695 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.546848 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.547052 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.547224 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.547386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.547555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.547714 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.547866 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.548016 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.548179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.548331 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.548490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.548649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.548800 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.548960 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.549120 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.549286 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.549440 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.549609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.549788 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.550101 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.550263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.550423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.550584 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.550744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.550896 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.551061 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.551229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.551389 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.551541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.551699 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.551862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.552023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.552353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.552511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.552672 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.552831 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.553109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.553276 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.553437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.553589 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.553750 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.553902 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.554094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.554272 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.554438 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.554590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.554743 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.554997 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.555411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.555587 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.555742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.555903 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.556067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.556219 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.556219 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.556569 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.556743 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.556899 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.557050 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.557218 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.557370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.557529 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.557724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.557877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.558054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.558232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.558393 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.558552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.558753 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.558911 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.559062 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.559229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.559380 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.559531 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.559681 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.559832 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.559982 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.560145 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.560296 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.560446 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.560596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.560781 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.560943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.561102 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.561263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.561415 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.561573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.561731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.561897 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.562116 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.562292 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.562665 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.562861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.563014 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.563314 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.563474 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.563625 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.563786 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.563945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.564096 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.564262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.564414 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.564565 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.564724 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.564876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.564876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.565185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.565345 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.565496 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.565662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.565813 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.565978 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.566168 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.566322 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.566473 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.566631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.566794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.566957 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.567109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.567272 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.567434 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.567599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.567759 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.567910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.568060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.568218 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.568369 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.568598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.568752 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.568903 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.569054 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.569205 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.569375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.569539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.569698 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.569850 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.570011 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.570223 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.570387 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.570549 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.571411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.571577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.571737 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.571898 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.572073 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.572225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.572375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.573007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.573165 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.573336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.573593 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.573752 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.573904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.574081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.574239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.574390 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.574558 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.574734 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.574886 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.575045 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.575197 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.575366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.575526 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.575687 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.575839 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.575991 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.576141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.576307 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.576459 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.576611 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.576783 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.576934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.577093 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.577260 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.577419 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.577571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.577722 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.577872 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.578024 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.578386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.578583 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.578737 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.578889 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.579060 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.579221 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.579392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.579545 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.579697 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.579848 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.579999 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.580163 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.580316 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.580466 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.580617 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.580767 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.580929 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.581096 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.581251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.581410 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.581561 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.581713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.581863 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.582030 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.582220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.582371 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.582533 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.582685 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.582851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.583184 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.583350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.583514 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.583772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.583942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.584119 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.584271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.584422 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.584581 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.584732 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.584882 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.585046 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.585198 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.585359 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.585517 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.585616 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.585698 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.585842 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.585945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.586032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.586184 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.586313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.586460 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.586590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.586590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.586842 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.586980 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.587108 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.587251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.587461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.587600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.587736 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.587941 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.588087 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.588247 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.588411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.588547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.588677 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.588805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.588946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.589084 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.589213 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.589354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.589484 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.589619 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.589763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.589901 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.590030 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.590175 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.590306 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.590434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.590590 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.590730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.590860 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.590987 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.591126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.591263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.591402 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.591532 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.591660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.591788 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.591915 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.592050 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.592193 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.592330 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.592468 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.592606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.592735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.592874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.593012 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.593305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.593444 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.593583 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.593713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.594153 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.594300 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.594430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.594567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.594696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.594823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.594964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595093 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595221 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595221 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595221 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595587 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.595724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.596307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.596452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.596452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.596696 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.596824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.596824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.596824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.597198 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.597340 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.597340 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.597607 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.597745 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.597881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.598019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.598019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.598295 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.598423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.598423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.598687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.598827 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.599007 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.599148 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.599148 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.599404 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.599552 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.599552 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.599804 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.599933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.600079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.600223 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.600223 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.600474 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.600603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.600738 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.600877 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.600877 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.601139 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.601268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.601395 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.601531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.601531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.601801 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.601942 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.601942 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.602256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.602384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.602384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.602384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.602384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.602868 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.602996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.602996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.603266 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.603547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.603689 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.603818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.603946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.604185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.604185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.604455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.604594 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.604594 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.604852 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.604990 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.605119 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.605254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.605254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.605506 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.605633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.605633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.605885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.606012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.606174 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.606312 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.606312 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.606576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.606706 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.606706 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.606964 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.607093 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.607229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.607365 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.607501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.607630 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.607630 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.607879 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.608023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.608160 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.608289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.608289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.608552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.608680 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.608680 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.608940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.609068 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.609196 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.609337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.609337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.609337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.609337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.609337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.609993 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.610189 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.610338 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.610468 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.610468 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.610708 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.610836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.610836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611993 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.611993 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.612253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.612390 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.612390 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.612659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.612796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.612796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.613048 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.613175 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.613400 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.613699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.613841 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.613978 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.614178 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.614438 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.614584 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.614723 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.614859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.615018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.615236 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.615421 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.615663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.615797 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.616070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.616202 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.616409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.616551 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.616751 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.617007 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.617139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.617437 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.617755 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.617942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.618107 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.618441 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.618572 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.618767 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.618966 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.619357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.619491 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.619730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.619874 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.620089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.620430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.620570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.620769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.620994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.621138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.621383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.621594 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.621729 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.621909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.622066 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.622370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.622501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.622691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.622862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.622999 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.623303 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.623445 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.623754 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.623911 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.624051 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.624226 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.624366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.624605 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.624737 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.624875 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.625178 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.625384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.625528 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.625799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.625941 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.626126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.626258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.626468 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.626599 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.626793 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.626944 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.627114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.627361 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.627497 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.627749 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.628048 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.628325 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.628459 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.628661 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.628792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.628973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.629222 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.629356 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.629612 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.629752 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.629928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.630154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.630303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.630582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.630725 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.631006 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.631138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.631328 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.631468 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.631655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.631888 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.632029 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.632284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.632414 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.632610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.632794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.632927 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.633232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.633374 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.633545 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.633709 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.633996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.634196 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.634327 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.634556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.634797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.634939 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.635069 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.635205 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.635439 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.635597 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.635868 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.636002 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.636292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.636423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.636718 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.636856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.637050 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.637224 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.638030 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.638208 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.638341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.638341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.638586 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.638720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.638872 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.639009 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.639145 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.639273 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.639685 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.639846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.640046 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.640177 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.640346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.640512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.640653 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.641042 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.641240 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.641518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.641725 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.641894 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.642075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.642224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.642535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.642717 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.643061 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.643194 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.643534 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.643678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.644210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.644389 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.644531 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.644671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.644904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.645212 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.645348 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.645588 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.645729 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.646053 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.646280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.646486 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.646877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.647059 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.647322 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.647505 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.647827 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.647986 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.648499 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.648755 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.649082 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.649216 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.649570 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.649730 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.649962 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.650117 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.650340 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.650525 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.650695 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.650954 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.651095 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.651557 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.651698 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.651844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.651975 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.652114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.652244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.652381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.652588 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.652734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.653257 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.653440 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.653685 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.653828 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.653970 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.654155 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.654462 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.654596 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.654739 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.654879 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.655019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.655150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.655412 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.655618 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.655750 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.655888 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.656028 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.656159 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.656290 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.656518 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.656662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.656806 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.656950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.657086 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.657215 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.657342 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.657471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.657682 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.657814 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.657943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.658193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.658408 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.658544 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.658685 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.658827 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.658958 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.659087 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.659259 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.659406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.659615 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.659748 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.659934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.660065 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.660244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.660385 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.660575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.660717 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.660921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.661062 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.661236 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.661382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.661551 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.661685 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.661821 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 16:17:45.661952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.662187 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.662495 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.662806 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.663126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.663437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.663742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.664046 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.664501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.664650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.664953 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.665255 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.665565 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.665870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.666196 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.666500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.666800 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.667100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.667401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.667704 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.668009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.668341 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.668752 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.669060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.669366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.669667 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.670002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.670359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.670672 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.670998 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.671309 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.671630 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.671955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.672282 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.672603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.672921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.673233 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.673566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.673876 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.677305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.677305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.677305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.677305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.677305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.677305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.677305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.677305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.682556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.682556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.682556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.682556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.682556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.682556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.682556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.682556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.683347 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.683347 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.683347 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.683347 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.683980 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.684176 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.684538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.685150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.686018 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.689513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.690078 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.690488 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.690858 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.691208 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.691554 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.692106 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 16:17:45.692281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 16:17:45.692894 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117202) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:17:45.716477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_db.sqlalchemy.engines [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:17:45.759206 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.context [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a95edbfc-1ac9-4e2d-aad7-de147f566f45(cell1) {{(pid=117202) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 16:17:45.763639 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:17:45.765221 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:17:45.766275 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:17:45.768273 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:17:45.779383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117202) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:17:45.780702 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117202) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:17:45.785451 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.context [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a95edbfc-1ac9-4e2d-aad7-de147f566f45(cell1) {{(pid=117201) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 16:17:45.790079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:17:45.791807 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:17:45.792610 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:17:45.794568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:17:45.806177 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_db.sqlalchemy.engines [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:17:45.807688 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_db.sqlalchemy.engines [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:17:45.940612 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117202) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:17:45.970118 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_db.sqlalchemy.engines [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 16:17:46.383109 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: WARNING keystonemiddleware.auth_token [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 16:17:46.389673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: WARNING keystonemiddleware.auth_token [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 16:17:46.405626 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: WARNING keystonemiddleware.auth_token [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 16:17:46.412425 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: WARNING keystonemiddleware.auth_token [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 16:17:46.614187 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: WARNING keystonemiddleware.auth_token [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 16:17:46.619383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: WARNING keystonemiddleware.auth_token [None req-d4c6b886-a30a-4cbd-ac9c-e1a3ac7bc212 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 16:17:46.624968 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555ef80a9c0 pid: 117202 (default app) Apr 12 16:17:46.636402 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: WARNING keystonemiddleware.auth_token [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 16:17:46.641596 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: WARNING keystonemiddleware.auth_token [None req-cfc29c54-c71f-4963-8f2c-c4028bed796b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 16:17:46.647060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555ef80a9c0 pid: 117201 (default app) Apr 12 16:18:28.849108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a8bae166-9e4c-43ac-834b-91ff271dba00 tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] Action: 'create', calling method: .version_select at 0x7f246fa699d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1098496014", "metadata": {"Type": "work"}}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:30.191715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-65edf8c0-f291-4e75-a8a6-d6f3a2bda4c5 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Action: 'create', calling method: .version_select at 0x7f246fa67a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1885465370", "metadata": {"Type": "work"}}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:30.194538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-65edf8c0-f291-4e75-a8a6-d6f3a2bda4c5 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:18:30.195666 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-65edf8c0-f291-4e75-a8a6-d6f3a2bda4c5 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.263456 Apr 12 16:18:30.202968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1155 bytes} [Tue Apr 12 16:18:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:18:30.209640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-00aefbde-324d-4de5-919b-57825cf6be60 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Action: 'create', calling method: .version_select at 0x7f246fa81820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-989798945", "metadata": {"Type": "work"}}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:30.211649 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-00aefbde-324d-4de5-919b-57825cf6be60 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:18:30.213230 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-00aefbde-324d-4de5-919b-57825cf6be60 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008149 Apr 12 16:18:30.218571 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 2/2] 10.222.0.67 () {60 vars in 1155 bytes} [Tue Apr 12 16:18:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:18:30.223970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-70e8d7af-9daa-47c1-8eb1-bf2f2c2e255a tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Action: 'create', calling method: .version_select at 0x7f246fa67ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1621112253", "metadata": {"Type": "work"}}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:30.225375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-70e8d7af-9daa-47c1-8eb1-bf2f2c2e255a tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:18:30.226366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-70e8d7af-9daa-47c1-8eb1-bf2f2c2e255a tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006587 Apr 12 16:18:30.227036 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 3/3] 10.222.0.67 () {60 vars in 1155 bytes} [Tue Apr 12 16:18:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:18:30.237314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6a76649a-e1a8-4491-add3-7763fe46270f tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Calling method '.version_select at 0x7f246f9b7550>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:30.964491 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-6a76649a-e1a8-4491-add3-7763fe46270f tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] HTTP exception thrown: Volume tempest-invalid-2127342703 could not be found. Apr 12 16:18:30.965286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6a76649a-e1a8-4491-add3-7763fe46270f tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Returning 404 to user: Volume tempest-invalid-2127342703 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:18:30.966477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6a76649a-e1a8-4491-add3-7763fe46270f tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2127342703" status: 404 len: 99 microversion: 2.1 time: 0.733585 Apr 12 16:18:30.967033 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 4/4] 10.222.0.67 () {58 vars in 1217 bytes} [Tue Apr 12 16:18:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2127342703 => generated 99 bytes in 735 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 16:18:30.981864 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6a6f6304-52e4-4cc5-a16c-8309d139cdd3 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008724 Apr 12 16:18:30.989556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 5/5] 10.222.0.67 () {58 vars in 1139 bytes} [Tue Apr 12 16:18:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 12 16:18:31.004597 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3787bad6-cf6a-4c99-a4e2-d328cad0afe2 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013600 Apr 12 16:18:31.005220 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 6/6] 10.222.0.67 () {58 vars in 1136 bytes} [Tue Apr 12 16:18:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 16:18:31.025767 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8ef7c606-fdc4-4b12-8ae0-8a1c481b2614 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Calling method '.version_select at 0x7f246f8d0e50>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:31.114133 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a8bae166-9e4c-43ac-834b-91ff271dba00 tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.385544 Apr 12 16:18:31.115822 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 1/7] 10.222.0.67 () {60 vars in 1155 bytes} [Tue Apr 12 16:18:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3389 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 12 16:18:31.136817 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f7990515-c9ba-42fc-910f-465aeaa600f0 tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] Calling method '.version_select at 0x7f246f93c940>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:31.173429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-8ef7c606-fdc4-4b12-8ae0-8a1c481b2614 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] HTTP exception thrown: Volume 74aec3dc-3a2f-4840-8bfb-561b99bbab60 could not be found. Apr 12 16:18:31.174389 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8ef7c606-fdc4-4b12-8ae0-8a1c481b2614 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Returning 404 to user: Volume 74aec3dc-3a2f-4840-8bfb-561b99bbab60 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:18:31.175777 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8ef7c606-fdc4-4b12-8ae0-8a1c481b2614 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/74aec3dc-3a2f-4840-8bfb-561b99bbab60" status: 404 len: 109 microversion: 2.1 time: 0.159536 Apr 12 16:18:31.176904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 7/8] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:18:31 2022] DELETE /compute/v2.1/os-volumes/74aec3dc-3a2f-4840-8bfb-561b99bbab60 => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:18:31.187831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cb862be2-3aa4-4cfe-aba4-a58af4cab1e6 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Calling method '.version_select at 0x7f246f8d0dc0>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:31.285080 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f7990515-c9ba-42fc-910f-465aeaa600f0 tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b" status: 200 len: 353 microversion: 2.1 time: 0.161089 Apr 12 16:18:31.285810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 2/9] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:31 2022] GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:31.326582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-cb862be2-3aa4-4cfe-aba4-a58af4cab1e6 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] HTTP exception thrown: Volume aeb37fe7-8ad2-401d-9eac-4129c9d795ea could not be found. Apr 12 16:18:31.330591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cb862be2-3aa4-4cfe-aba4-a58af4cab1e6 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] Returning 404 to user: Volume aeb37fe7-8ad2-401d-9eac-4129c9d795ea could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:18:31.331829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-cb862be2-3aa4-4cfe-aba4-a58af4cab1e6 tempest-VolumesNegativeTest-1524667716 tempest-VolumesNegativeTest-1524667716-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/aeb37fe7-8ad2-401d-9eac-4129c9d795ea" status: 404 len: 109 microversion: 2.1 time: 0.149117 Apr 12 16:18:31.341411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 8/10] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:31 2022] GET /compute/v2.1/os-volumes/aeb37fe7-8ad2-401d-9eac-4129c9d795ea => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:18:32.297785 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9a3f7a78-b5c9-44c0-a21a-32bbf260f69b tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] Calling method '.version_select at 0x7f246f93caf0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:32.390113 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9a3f7a78-b5c9-44c0-a21a-32bbf260f69b tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b" status: 200 len: 354 microversion: 2.1 time: 0.095996 Apr 12 16:18:32.391189 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 3/11] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:32 2022] GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:32.404372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f3f705db-f9df-4d05-99ef-65b57516ddfe tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] Calling method '.version_select at 0x7f246f8e8790>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:32.518579 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f3f705db-f9df-4d05-99ef-65b57516ddfe tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b" status: 200 len: 354 microversion: 2.1 time: 0.119154 Apr 12 16:18:32.519365 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 9/12] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:32 2022] GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:32.537641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-594f6b44-37ab-48d6-aada-0c7f36e2f3c3 tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] Calling method '.version_select at 0x7f246f8d0c10>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:32.658300 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-594f6b44-37ab-48d6-aada-0c7f36e2f3c3 tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b" status: 202 len: 0 microversion: 2.1 time: 0.129309 Apr 12 16:18:32.658859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 10/13] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:18:32 2022] DELETE /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:18:32.668376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0ed7b17c-3967-46a2-8dc7-6a65d9d6240c tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] Calling method '.version_select at 0x7f246f8e8160>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:32.740011 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1882423940", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "networks": [{"uuid": "094cf5c7-571a-4588-982d-7264585fb556"}]}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:32.774892 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0ed7b17c-3967-46a2-8dc7-6a65d9d6240c tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b" status: 200 len: 353 microversion: 2.1 time: 0.111413 Apr 12 16:18:32.776193 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 11/14] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:32 2022] GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:32.915724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] validate_networks() for [('094cf5c7-571a-4588-982d-7264585fb556', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:18:33.788539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b5456592-187e-4252-90c8-cd39598655fe tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] Calling method '.version_select at 0x7f246f8e85e0>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:33.820264 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-b5456592-187e-4252-90c8-cd39598655fe tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] HTTP exception thrown: Volume ed6a1b9e-421d-48d8-b79b-af2b64278e5b could not be found. Apr 12 16:18:33.821079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b5456592-187e-4252-90c8-cd39598655fe tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] Returning 404 to user: Volume ed6a1b9e-421d-48d8-b79b-af2b64278e5b could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:18:33.822605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b5456592-187e-4252-90c8-cd39598655fe tempest-VolumesGetTestJSON-1078971343 tempest-VolumesGetTestJSON-1078971343-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b" status: 404 len: 109 microversion: 2.1 time: 0.038098 Apr 12 16:18:33.824300 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 12/15] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:33 2022] GET /compute/v2.1/os-volumes/ed6a1b9e-421d-48d8-b79b-af2b64278e5b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:18:34.550460 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:18:34.552205 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:18:34.552845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:18:34.553359 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:18:34.553876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:18:34.599369 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:34.601986 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:34.603171 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:34.604779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:34.662432 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Getting quotas for project 7b531609069a4de8b99bbdf8d139cb2c. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:34.700862 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Getting quotas for user cbcf6972f4064287ab19383277ee8b58 and project 7b531609069a4de8b99bbdf8d139cb2c. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:34.745696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:18:34.758205 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:18:34.932961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bd77d8ad-341b-4268-a92f-141f6ec02705 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.482147 Apr 12 16:18:34.933626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 4/16] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:18:34.947018 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-68d053c5-8f35-4a29-8db9-d930f14ce35e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:34.948454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-68d053c5-8f35-4a29-8db9-d930f14ce35e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:35.278356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-68d053c5-8f35-4a29-8db9-d930f14ce35e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:35.310601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-68d053c5-8f35-4a29-8db9-d930f14ce35e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1215 microversion: 2.1 time: 0.367981 Apr 12 16:18:35.312453 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 13/17] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:34 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1215 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:36.330881 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-26a4d8a7-e83a-449a-991c-ed21721532a7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:36.331480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-26a4d8a7-e83a-449a-991c-ed21721532a7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:37.149535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-26a4d8a7-e83a-449a-991c-ed21721532a7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:37.176941 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-26a4d8a7-e83a-449a-991c-ed21721532a7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1215 microversion: 2.1 time: 0.844653 Apr 12 16:18:37.181824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 5/18] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:36 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1215 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:38.198075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d474350e-301a-4931-80bc-3b7be591f869 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:38.198807 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d474350e-301a-4931-80bc-3b7be591f869 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:38.215688 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d474350e-301a-4931-80bc-3b7be591f869 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:38.217126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d474350e-301a-4931-80bc-3b7be591f869 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:38.218064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d474350e-301a-4931-80bc-3b7be591f869 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:38.218667 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d474350e-301a-4931-80bc-3b7be591f869 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:38.859094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d474350e-301a-4931-80bc-3b7be591f869 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:38.904903 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d474350e-301a-4931-80bc-3b7be591f869 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1285 microversion: 2.1 time: 0.711531 Apr 12 16:18:38.908160 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 14/19] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:38 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1285 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:18:39.923249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dc873aee-2f7e-4388-a367-bed6fc793f9c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:39.923869 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dc873aee-2f7e-4388-a367-bed6fc793f9c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:39.948975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dc873aee-2f7e-4388-a367-bed6fc793f9c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:39.949607 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dc873aee-2f7e-4388-a367-bed6fc793f9c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:39.953859 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dc873aee-2f7e-4388-a367-bed6fc793f9c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:39.956346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dc873aee-2f7e-4388-a367-bed6fc793f9c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:41.041151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dc873aee-2f7e-4388-a367-bed6fc793f9c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:41.084020 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dc873aee-2f7e-4388-a367-bed6fc793f9c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1273 microversion: 2.1 time: 1.160125 Apr 12 16:18:41.087403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 6/20] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:39 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1273 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:42.104017 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9487eb1d-05b2-46a3-8c58-844ca4f63915 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:42.104832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9487eb1d-05b2-46a3-8c58-844ca4f63915 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:42.126409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9487eb1d-05b2-46a3-8c58-844ca4f63915 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:42.126956 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9487eb1d-05b2-46a3-8c58-844ca4f63915 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:42.127784 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9487eb1d-05b2-46a3-8c58-844ca4f63915 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:42.128225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9487eb1d-05b2-46a3-8c58-844ca4f63915 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:42.352120 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9487eb1d-05b2-46a3-8c58-844ca4f63915 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:42.360577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9487eb1d-05b2-46a3-8c58-844ca4f63915 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1273 microversion: 2.1 time: 0.261757 Apr 12 16:18:42.361186 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 7/21] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:42 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:42.381241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6bc6de8a-ccfb-420a-b5ab-df15537a0b46 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246e785e50>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:42.534765 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3451e3ea-2487-4c45-933b-5c449e16ce86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: .version_select at 0x7f246f84c820>, body: {"keypair": {"name": "tempest-keypair-8788159"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:42.559965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6bc6de8a-ccfb-420a-b5ab-df15537a0b46 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/91959847-24bd-4a4d-a451-a18ae74635c9" status: 200 len: 351 microversion: 2.1 time: 0.195186 Apr 12 16:18:42.560555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 8/22] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:42 2022] GET /compute/v2.1/os-volumes/91959847-24bd-4a4d-a451-a18ae74635c9 => generated 351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:42.682191 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-3451e3ea-2487-4c45-933b-5c449e16ce86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:42.697908 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-3451e3ea-2487-4c45-933b-5c449e16ce86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:43.390633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1b3fc9ec-516f-45d7-920a-52f0d6f709b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:43.392103 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1b3fc9ec-516f-45d7-920a-52f0d6f709b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:43.432549 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b3fc9ec-516f-45d7-920a-52f0d6f709b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:43.434240 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b3fc9ec-516f-45d7-920a-52f0d6f709b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:43.439991 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b3fc9ec-516f-45d7-920a-52f0d6f709b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:43.441786 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b3fc9ec-516f-45d7-920a-52f0d6f709b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:43.619002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-3451e3ea-2487-4c45-933b-5c449e16ce86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:43.633932 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-3451e3ea-2487-4c45-933b-5c449e16ce86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:43.675449 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1b3fc9ec-516f-45d7-920a-52f0d6f709b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:43.683160 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3451e3ea-2487-4c45-933b-5c449e16ce86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2302 microversion: 2.1 time: 1.909433 Apr 12 16:18:43.691912 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 15/23] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:18:41 2022] POST /compute/v2.1/os-keypairs => generated 2302 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:43.698756 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1b3fc9ec-516f-45d7-920a-52f0d6f709b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1273 microversion: 2.1 time: 0.321459 Apr 12 16:18:43.701714 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 9/24] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:43 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:18:44.391085 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-28d88c92-cc0e-4af6-9c1f-adf8afc9fb34 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246ef70700>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:44.549271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-28d88c92-cc0e-4af6-9c1f-adf8afc9fb34 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/29a7ab36-0ee0-4573-b334-2d63228265bc" status: 200 len: 351 microversion: 2.1 time: 0.162660 Apr 12 16:18:44.556094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 16/25] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:44 2022] GET /compute/v2.1/os-volumes/29a7ab36-0ee0-4573-b334-2d63228265bc => generated 351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:44.732791 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8856a163-1ab4-4eed-9e95-2c14fe629887 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:44.735553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8856a163-1ab4-4eed-9e95-2c14fe629887 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:44.759906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8856a163-1ab4-4eed-9e95-2c14fe629887 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:44.763087 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8856a163-1ab4-4eed-9e95-2c14fe629887 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:44.773119 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8856a163-1ab4-4eed-9e95-2c14fe629887 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:44.778180 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8856a163-1ab4-4eed-9e95-2c14fe629887 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:45.032518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8856a163-1ab4-4eed-9e95-2c14fe629887 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:45.051562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8856a163-1ab4-4eed-9e95-2c14fe629887 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1273 microversion: 2.1 time: 0.330817 Apr 12 16:18:45.066492 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 10/26] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:44 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:46.078610 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3c2f634f-d42b-4be1-9418-1b6ea8a1977c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:46.080126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3c2f634f-d42b-4be1-9418-1b6ea8a1977c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:46.115696 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3c2f634f-d42b-4be1-9418-1b6ea8a1977c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:46.116156 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3c2f634f-d42b-4be1-9418-1b6ea8a1977c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:46.131448 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3c2f634f-d42b-4be1-9418-1b6ea8a1977c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:46.131929 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3c2f634f-d42b-4be1-9418-1b6ea8a1977c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:46.438621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3c2f634f-d42b-4be1-9418-1b6ea8a1977c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:46.456925 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3c2f634f-d42b-4be1-9418-1b6ea8a1977c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.390655 Apr 12 16:18:46.481157 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 17/27] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:46 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:46.637428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b2759c8f-8b84-4e62-a48b-5bef627b3040 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246e785d30>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:46.773308 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b2759c8f-8b84-4e62-a48b-5bef627b3040 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ba27cdd4-c135-4001-833d-74521dc35e93" status: 200 len: 351 microversion: 2.1 time: 0.140474 Apr 12 16:18:46.774248 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 11/28] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:18:46 2022] GET /compute/v2.1/os-volumes/ba27cdd4-c135-4001-833d-74521dc35e93 => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:46.786029 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bd9cc1ab-1e20-40d6-a702-9c4f35d7aeb4 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246ef70ca0>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:46.983595 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bd9cc1ab-1e20-40d6-a702-9c4f35d7aeb4 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.201770 Apr 12 16:18:46.984876 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 18/29] 10.222.0.67 () {58 vars in 1133 bytes} [Tue Apr 12 16:18:46 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:46.998022 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2252b52f-d6be-4871-babf-f428206ce806 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246e713160>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:47.223026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2252b52f-d6be-4871-babf-f428206ce806 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.228636 Apr 12 16:18:47.224398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 12/30] 10.222.0.67 () {58 vars in 1148 bytes} [Tue Apr 12 16:18:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:18:47.256943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-14155d02-b8fa-4482-9deb-4c53c1c77282 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246ef6d790>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:47.502522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-71192d7a-9d3b-41f1-9f61-b6767e31ea8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:47.509368 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-71192d7a-9d3b-41f1-9f61-b6767e31ea8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:48.041258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-71192d7a-9d3b-41f1-9f61-b6767e31ea8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:48.043559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-71192d7a-9d3b-41f1-9f61-b6767e31ea8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:48.047458 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-71192d7a-9d3b-41f1-9f61-b6767e31ea8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:48.048854 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-71192d7a-9d3b-41f1-9f61-b6767e31ea8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:48.165764 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-14155d02-b8fa-4482-9deb-4c53c1c77282 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.932287 Apr 12 16:18:48.168539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 19/31] 10.222.0.67 () {58 vars in 1133 bytes} [Tue Apr 12 16:18:47 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:48.186853 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-fb7947d8-2bd1-45e1-b557-c7fa0b3fa20c tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246ef84160>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:48.375666 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-fb7947d8-2bd1-45e1-b557-c7fa0b3fa20c tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.196108 Apr 12 16:18:48.377028 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 20/32] 10.222.0.67 () {58 vars in 1166 bytes} [Tue Apr 12 16:18:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:18:48.383229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-558435167", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ecce0ebb-6f6d-41f3-91d1-6cb5caa3527a"}], "security_groups": [{"name": "tempest-securitygroup--901098515"}], "key_name": "tempest-keypair-8788159", "user_data": "}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:48.450326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-71192d7a-9d3b-41f1-9f61-b6767e31ea8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:48.463412 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-71192d7a-9d3b-41f1-9f61-b6767e31ea8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.971538 Apr 12 16:18:48.465089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 13/33] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:47 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:18:48.472786 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d91b9cfc-c78d-4d0c-8c41-621595b765fd tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246e713dc0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:48.679262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d91b9cfc-c78d-4d0c-8c41-621595b765fd tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.212299 Apr 12 16:18:48.680767 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 14/34] 10.222.0.67 () {58 vars in 1169 bytes} [Tue Apr 12 16:18:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:48.695154 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-224d0edd-68e4-4f97-966c-74c313f1d847 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246e785dc0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:48.715359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] validate_networks() for [('ecce0ebb-6f6d-41f3-91d1-6cb5caa3527a', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:18:48.951799 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-224d0edd-68e4-4f97-966c-74c313f1d847 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.261658 Apr 12 16:18:48.953574 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 15/35] 10.222.0.67 () {58 vars in 1154 bytes} [Tue Apr 12 16:18:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:48.970691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b6846c88-8b82-4c10-8501-66365342e887 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246e6d4940>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:49.246235 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b6846c88-8b82-4c10-8501-66365342e887 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.285113 Apr 12 16:18:49.248247 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 16/36] 10.222.0.67 () {58 vars in 1187 bytes} [Tue Apr 12 16:18:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:18:49.263770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-74e6d634-f6e3-4653-8955-b3b0056ed282 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] Calling method '.version_select at 0x7f246efed5e0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:49.570003 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-74e6d634-f6e3-4653-8955-b3b0056ed282 tempest-VolumesTestJSON-397486496 tempest-VolumesTestJSON-397486496-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.314011 Apr 12 16:18:49.571021 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 17/37] 10.222.0.67 () {58 vars in 1154 bytes} [Tue Apr 12 16:18:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:18:49.588470 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9d94b61c-e4b6-4b8b-9681-4aa4cf5bcb8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:49.589305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9d94b61c-e4b6-4b8b-9681-4aa4cf5bcb8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:49.609981 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d94b61c-e4b6-4b8b-9681-4aa4cf5bcb8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:49.615106 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d94b61c-e4b6-4b8b-9681-4aa4cf5bcb8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:49.616314 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d94b61c-e4b6-4b8b-9681-4aa4cf5bcb8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:49.617518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d94b61c-e4b6-4b8b-9681-4aa4cf5bcb8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:50.160271 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9d94b61c-e4b6-4b8b-9681-4aa4cf5bcb8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:50.180051 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9d94b61c-e4b6-4b8b-9681-4aa4cf5bcb8e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.607750 Apr 12 16:18:50.184526 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 18/38] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:49 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:50.449319 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:18:50.449917 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:18:50.450409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:18:50.450993 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:18:50.451277 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:18:50.479521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:50.480015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:50.484975 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:50.485458 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:50.581234 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:50.594834 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:50.628398 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:18:50.637878 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:18:50.818834 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-68fd798e-12a5-4d29-bec6-b3787ce6faf7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.440347 Apr 12 16:18:50.819971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 21/39] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:18:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 2442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:18:50.834772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a66a95c8-a97b-4cd5-b51a-f3d0ecfaf536 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:50.836745 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a66a95c8-a97b-4cd5-b51a-f3d0ecfaf536 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:51.029522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a66a95c8-a97b-4cd5-b51a-f3d0ecfaf536 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:51.041466 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a66a95c8-a97b-4cd5-b51a-f3d0ecfaf536 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1238 microversion: 2.1 time: 0.215093 Apr 12 16:18:51.058569 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 19/40] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:50 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1238 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:51.202461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6c73fa7c-cd9e-49cc-b2dd-0d865a692f7d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:51.203413 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6c73fa7c-cd9e-49cc-b2dd-0d865a692f7d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:51.219794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7c-cd9e-49cc-b2dd-0d865a692f7d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:51.222947 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7c-cd9e-49cc-b2dd-0d865a692f7d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:51.225768 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7c-cd9e-49cc-b2dd-0d865a692f7d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:51.227129 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7c-cd9e-49cc-b2dd-0d865a692f7d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:51.968652 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6c73fa7c-cd9e-49cc-b2dd-0d865a692f7d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:51.976961 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6c73fa7c-cd9e-49cc-b2dd-0d865a692f7d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.779763 Apr 12 16:18:51.977557 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 22/41] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:51 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:52.065857 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-470d1da5-b8c2-452a-94ad-bd623f77a19d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:52.067472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-470d1da5-b8c2-452a-94ad-bd623f77a19d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:52.298662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-470d1da5-b8c2-452a-94ad-bd623f77a19d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:52.308810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-470d1da5-b8c2-452a-94ad-bd623f77a19d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1238 microversion: 2.1 time: 0.249555 Apr 12 16:18:52.322237 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 20/42] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:52 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1238 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:52.995013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-da16edb5-0c24-4281-bac4-c6e1d7ed47b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:52.996203 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-da16edb5-0c24-4281-bac4-c6e1d7ed47b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:53.010606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da16edb5-0c24-4281-bac4-c6e1d7ed47b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:53.011401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da16edb5-0c24-4281-bac4-c6e1d7ed47b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:53.012603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da16edb5-0c24-4281-bac4-c6e1d7ed47b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:53.013237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da16edb5-0c24-4281-bac4-c6e1d7ed47b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:53.328191 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1000613f-d8bb-4eb7-83e1-19654b7dc7d1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:53.328970 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1000613f-d8bb-4eb7-83e1-19654b7dc7d1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:53.341923 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1000613f-d8bb-4eb7-83e1-19654b7dc7d1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:53.344958 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1000613f-d8bb-4eb7-83e1-19654b7dc7d1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:53.346094 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1000613f-d8bb-4eb7-83e1-19654b7dc7d1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:53.349982 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1000613f-d8bb-4eb7-83e1-19654b7dc7d1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:53.535009 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1000613f-d8bb-4eb7-83e1-19654b7dc7d1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:53.561884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1000613f-d8bb-4eb7-83e1-19654b7dc7d1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1242 microversion: 2.1 time: 0.237732 Apr 12 16:18:53.577633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 21/43] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:53 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1242 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:53.578951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-da16edb5-0c24-4281-bac4-c6e1d7ed47b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:53.592045 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-da16edb5-0c24-4281-bac4-c6e1d7ed47b2 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.601392 Apr 12 16:18:53.596171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 23/44] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:52 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:54.593679 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c2708c2b-c37e-494e-b3ae-c551127df846 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:54.594488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c2708c2b-c37e-494e-b3ae-c551127df846 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:54.604982 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c2708c2b-c37e-494e-b3ae-c551127df846 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:54.607239 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c2708c2b-c37e-494e-b3ae-c551127df846 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:54.612316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-66382c57-3bff-4eda-9c61-dc3eea244820 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:54.613922 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-66382c57-3bff-4eda-9c61-dc3eea244820 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:54.624645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c2708c2b-c37e-494e-b3ae-c551127df846 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:54.625102 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c2708c2b-c37e-494e-b3ae-c551127df846 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:54.629051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-66382c57-3bff-4eda-9c61-dc3eea244820 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:54.632440 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-66382c57-3bff-4eda-9c61-dc3eea244820 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:54.633281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-66382c57-3bff-4eda-9c61-dc3eea244820 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:54.633730 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-66382c57-3bff-4eda-9c61-dc3eea244820 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:55.207309 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c2708c2b-c37e-494e-b3ae-c551127df846 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:55.216868 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c2708c2b-c37e-494e-b3ae-c551127df846 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1242 microversion: 2.1 time: 0.633278 Apr 12 16:18:55.218062 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 22/45] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:54 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1242 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:55.536391 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-66382c57-3bff-4eda-9c61-dc3eea244820 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:55.544269 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-66382c57-3bff-4eda-9c61-dc3eea244820 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.936082 Apr 12 16:18:55.550329 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 24/46] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:54 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:55.581162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-a78f9e92-f80f-47cd-8d92-652e5be94c94 req-3772379a-508d-4ef2-b3b8-e9532de47ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487aea79-f1c3-4ab8-9d49-cee300992479", "tag": "f139bb8c-aace-4035-a88f-6180d6399d1b"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:55.647563 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-a78f9e92-f80f-47cd-8d92-652e5be94c94 req-3772379a-508d-4ef2-b3b8-e9532de47ab2 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:55.650488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-a78f9e92-f80f-47cd-8d92-652e5be94c94 req-3772379a-508d-4ef2-b3b8-e9532de47ab2 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:55.740805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-a78f9e92-f80f-47cd-8d92-652e5be94c94 req-3772379a-508d-4ef2-b3b8-e9532de47ab2 service nova] Creating event network-changed:f139bb8c-aace-4035-a88f-6180d6399d1b for instance 487aea79-f1c3-4ab8-9d49-cee300992479 on hv-cinder-83752 Apr 12 16:18:55.744232 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-a78f9e92-f80f-47cd-8d92-652e5be94c94 req-3772379a-508d-4ef2-b3b8-e9532de47ab2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117202) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 12 16:18:55.747742 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f2a5d95e-45cc-4842-8572-602cc93b572e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:55.748305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f2a5d95e-45cc-4842-8572-602cc93b572e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:55.749626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f2a5d95e-45cc-4842-8572-602cc93b572e None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:55.755327 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f2a5d95e-45cc-4842-8572-602cc93b572e None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:55.806306 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.compute.rpcapi [None req-f2a5d95e-45cc-4842-8572-602cc93b572e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 12 16:18:55.808975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f2a5d95e-45cc-4842-8572-602cc93b572e None None] Releasing lock "compute-rpcapi-router" {{(pid=117202) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 16:18:55.867209 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f2a5d95e-45cc-4842-8572-602cc93b572e None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.647678 Apr 12 16:18:55.868425 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 23/47] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:56.364256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-aff5baa1-18ad-4f1c-8000-685cea1e3a51 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'create', calling method: .version_select at 0x7f246dea14c0>, body: {"keypair": {"name": "tempest-keypair-478533550"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:56.409667 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-aff5baa1-18ad-4f1c-8000-685cea1e3a51 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:56.427617 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-aff5baa1-18ad-4f1c-8000-685cea1e3a51 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for user ff1435d492ce4751a0b4eac7558ad9d6 and project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:56.525854 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-814956612", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:56.602766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] validate_networks() for [('1a816f2a-7737-4dcf-8e4f-8a7eee1e8062', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:18:56.912031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-aff5baa1-18ad-4f1c-8000-685cea1e3a51 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:56.922627 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-aff5baa1-18ad-4f1c-8000-685cea1e3a51 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for user ff1435d492ce4751a0b4eac7558ad9d6 and project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:56.986884 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-aff5baa1-18ad-4f1c-8000-685cea1e3a51 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.435106 Apr 12 16:18:56.993027 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 25/48] 10.222.0.67 () {62 vars in 1198 bytes} [Tue Apr 12 16:18:55 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1437 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:18:56.998896 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-dd995858-27b3-40d6-9e15-646b10d4420f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:56.999020 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-dd995858-27b3-40d6-9e15-646b10d4420f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:57.029997 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dd995858-27b3-40d6-9e15-646b10d4420f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:57.030475 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dd995858-27b3-40d6-9e15-646b10d4420f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:57.031277 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dd995858-27b3-40d6-9e15-646b10d4420f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:57.031722 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dd995858-27b3-40d6-9e15-646b10d4420f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:57.810131 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dd995858-27b3-40d6-9e15-646b10d4420f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:57.823744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-dd995858-27b3-40d6-9e15-646b10d4420f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1296 microversion: 2.1 time: 0.835068 Apr 12 16:18:57.830455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 26/49] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:56 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1296 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:57.848318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3b53aa98-d3c8-4876-a76b-9a22fd321bf0 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:57.855353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3b53aa98-d3c8-4876-a76b-9a22fd321bf0 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:57.878662 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3b53aa98-d3c8-4876-a76b-9a22fd321bf0 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:57.879275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3b53aa98-d3c8-4876-a76b-9a22fd321bf0 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:57.880957 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3b53aa98-d3c8-4876-a76b-9a22fd321bf0 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:57.888240 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3b53aa98-d3c8-4876-a76b-9a22fd321bf0 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:58.357824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:18:58.359052 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:18:58.359774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:18:58.360488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:18:58.361106 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:18:58.377121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:58.377590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:58.378418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:58.382766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:58.415993 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3b53aa98-d3c8-4876-a76b-9a22fd321bf0 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:58.448461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3b53aa98-d3c8-4876-a76b-9a22fd321bf0 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.615084 Apr 12 16:18:58.449052 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 27/50] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:57 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:58.456726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for project edcd271496524c94929c1a28a63f96ef. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:58.468943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for user e0a8dd6313744c0bac80289882e9b78d and project edcd271496524c94929c1a28a63f96ef. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:58.485185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:18:58.488410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:18:58.589915 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-09c7067d-2e4b-4849-95a2-b49368c88643 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.714744 Apr 12 16:18:58.590654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 24/51] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:18:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:18:58.603474 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3193a1ee-6a94-4cf6-9a25-e65b4ae7c7bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:58.605381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3193a1ee-6a94-4cf6-9a25-e65b4ae7c7bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:58.700412 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3193a1ee-6a94-4cf6-9a25-e65b4ae7c7bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:58.708949 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3193a1ee-6a94-4cf6-9a25-e65b4ae7c7bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1221 microversion: 2.1 time: 0.111705 Apr 12 16:18:58.710930 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 25/52] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:58 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:18:58.847861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-de1c49cb-69e7-45a3-96f2-1a5971b54184 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:58.848989 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-de1c49cb-69e7-45a3-96f2-1a5971b54184 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:58.860816 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-de1c49cb-69e7-45a3-96f2-1a5971b54184 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:58.861284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-de1c49cb-69e7-45a3-96f2-1a5971b54184 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:58.863296 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-de1c49cb-69e7-45a3-96f2-1a5971b54184 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:58.864295 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-de1c49cb-69e7-45a3-96f2-1a5971b54184 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:59.059663 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-de1c49cb-69e7-45a3-96f2-1a5971b54184 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:18:59.078663 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-de1c49cb-69e7-45a3-96f2-1a5971b54184 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1296 microversion: 2.1 time: 0.234296 Apr 12 16:18:59.088236 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 26/53] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:58 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1296 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:59.090637 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-62302949", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:59.130080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-95ab513f-3080-46ad-a40a-44e75428b83a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'create', calling method: .version_select at 0x7f246ef043a0>, body: {"keypair": {"name": "tempest-keypair-1216905054"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:59.176424 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-95ab513f-3080-46ad-a40a-44e75428b83a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for project 9e274b464718459ea125ef2d5b5003ce. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:59.188162 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-95ab513f-3080-46ad-a40a-44e75428b83a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for user adf30b4421074395b1b70e44bcf6ed10 and project 9e274b464718459ea125ef2d5b5003ce. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:59.190516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] validate_networks() for [('1a816f2a-7737-4dcf-8e4f-8a7eee1e8062', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:18:59.613891 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-95ab513f-3080-46ad-a40a-44e75428b83a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for project 9e274b464718459ea125ef2d5b5003ce. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:59.617967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-95ab513f-3080-46ad-a40a-44e75428b83a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for user adf30b4421074395b1b70e44bcf6ed10 and project 9e274b464718459ea125ef2d5b5003ce. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:59.644991 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-95ab513f-3080-46ad-a40a-44e75428b83a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.194758 Apr 12 16:18:59.649588 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 28/54] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:18:58 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:59.666365 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6b0faba9-0e1d-44d0-aef2-f0bc93fcba59 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:59.667210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6b0faba9-0e1d-44d0-aef2-f0bc93fcba59 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:18:59.682816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b0faba9-0e1d-44d0-aef2-f0bc93fcba59 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:59.685831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b0faba9-0e1d-44d0-aef2-f0bc93fcba59 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:18:59.691461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b0faba9-0e1d-44d0-aef2-f0bc93fcba59 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:18:59.692421 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b0faba9-0e1d-44d0-aef2-f0bc93fcba59 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:01.140965 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6b0faba9-0e1d-44d0-aef2-f0bc93fcba59 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:01.162300 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6b0faba9-0e1d-44d0-aef2-f0bc93fcba59 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 1.501628 Apr 12 16:19:01.168362 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 29/55] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:18:59 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:01.181687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f54e0a91-4363-4033-a330-863a6172b89a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:01.184579 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f54e0a91-4363-4033-a330-863a6172b89a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:01.205634 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f54e0a91-4363-4033-a330-863a6172b89a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:01.206356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f54e0a91-4363-4033-a330-863a6172b89a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:01.207318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f54e0a91-4363-4033-a330-863a6172b89a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:01.207999 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f54e0a91-4363-4033-a330-863a6172b89a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:01.557491 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:19:01.558760 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:19:01.559460 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:19:01.560074 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:19:01.560673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:19:01.577832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:01.578855 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:01.581716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:01.582489 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:01.647079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f54e0a91-4363-4033-a330-863a6172b89a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:01.659305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f54e0a91-4363-4033-a330-863a6172b89a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.486501 Apr 12 16:19:01.660974 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 30/56] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:01 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:01.695097 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-682252403", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "659bb59b-3f11-4e82-88df-ec448e9e7e28"}], "security_groups": [{"name": "tempest-securitygroup--1768273553"}], "key_name": "tempest-keypair-478533550", "user_data": "}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:01.704730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for project edcd271496524c94929c1a28a63f96ef. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:19:01.724108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for user e0a8dd6313744c0bac80289882e9b78d and project edcd271496524c94929c1a28a63f96ef. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:19:01.763461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:19:01.765621 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:19:01.898596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1b0b063c-e53a-4588-8a25-6dafddfead7d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.816025 Apr 12 16:19:01.899600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 27/57] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:18:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:19:01.914690 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-89dd5a19-c9cc-4b19-a906-c027080313a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:01.916490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-89dd5a19-c9cc-4b19-a906-c027080313a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:01.921452 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] validate_networks() for [('659bb59b-3f11-4e82-88df-ec448e9e7e28', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:19:02.234961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-89dd5a19-c9cc-4b19-a906-c027080313a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:02.243012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-89dd5a19-c9cc-4b19-a906-c027080313a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1220 microversion: 2.1 time: 0.335673 Apr 12 16:19:02.243636 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 28/58] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:01 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1220 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:02.276845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f8805d9e-bdf6-4d77-a7c4-b29a8fad8528 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:02.278393 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f8805d9e-bdf6-4d77-a7c4-b29a8fad8528 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:02.323770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f8805d9e-bdf6-4d77-a7c4-b29a8fad8528 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:02.324247 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f8805d9e-bdf6-4d77-a7c4-b29a8fad8528 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:02.325059 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f8805d9e-bdf6-4d77-a7c4-b29a8fad8528 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:02.325506 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f8805d9e-bdf6-4d77-a7c4-b29a8fad8528 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:03.733209 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f8805d9e-bdf6-4d77-a7c4-b29a8fad8528 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:03.750023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f8805d9e-bdf6-4d77-a7c4-b29a8fad8528 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 1.496633 Apr 12 16:19:03.750671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 29/59] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:02 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:03.775286 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d5194188-f17f-46b4-b124-1182ed0e55db tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:03.777560 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d5194188-f17f-46b4-b124-1182ed0e55db tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:03.804827 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d5194188-f17f-46b4-b124-1182ed0e55db tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:03.807709 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d5194188-f17f-46b4-b124-1182ed0e55db tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:03.809816 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d5194188-f17f-46b4-b124-1182ed0e55db tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:03.825768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d5194188-f17f-46b4-b124-1182ed0e55db tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:04.351410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d5194188-f17f-46b4-b124-1182ed0e55db tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:04.360480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d5194188-f17f-46b4-b124-1182ed0e55db tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.608714 Apr 12 16:19:04.361176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 30/60] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:03 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:04.373586 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-23eaa423-8986-45f0-92d8-fe716c0c48b8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:04.374475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-23eaa423-8986-45f0-92d8-fe716c0c48b8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:04.384347 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-23eaa423-8986-45f0-92d8-fe716c0c48b8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:04.385230 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-23eaa423-8986-45f0-92d8-fe716c0c48b8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:04.386390 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-23eaa423-8986-45f0-92d8-fe716c0c48b8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:04.386961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-23eaa423-8986-45f0-92d8-fe716c0c48b8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:04.478224 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:19:04.479992 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:19:04.480638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:19:04.481057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:19:04.481499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:19:04.493754 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:04.494381 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:04.495190 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:04.495627 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:04.515557 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:19:04.520241 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for user ff1435d492ce4751a0b4eac7558ad9d6 and project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:19:04.536706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:19:04.539400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:19:04.546691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-23eaa423-8986-45f0-92d8-fe716c0c48b8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:04.559231 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-23eaa423-8986-45f0-92d8-fe716c0c48b8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1272 microversion: 2.1 time: 0.194558 Apr 12 16:19:04.559856 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 31/61] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:04 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:04.603103 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-750778322", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "028a45e4-8708-408c-a3b9-d772d5389f9f"}], "security_groups": [{"name": "tempest-securitygroup--692652111"}], "key_name": "tempest-keypair-1216905054", "user_data": "}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:04.608799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-77df7991-d699-40b1-960a-ae851a81f763 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.933518 Apr 12 16:19:04.609580 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 31/62] 10.222.0.67 () {62 vars in 1187 bytes} [Tue Apr 12 16:19:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 12 16:19:04.621014 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-36c70b4c-5a77-49f3-96ba-e99eb8e1649b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:04.621914 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-36c70b4c-5a77-49f3-96ba-e99eb8e1649b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:04.728788 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-36c70b4c-5a77-49f3-96ba-e99eb8e1649b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:04.742257 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-36c70b4c-5a77-49f3-96ba-e99eb8e1649b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:04.745690 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-36c70b4c-5a77-49f3-96ba-e99eb8e1649b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:04.747454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-36c70b4c-5a77-49f3-96ba-e99eb8e1649b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1280 microversion: 2.20 time: 0.130711 Apr 12 16:19:04.748551 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 32/63] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:04 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:19:04.767934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1ee19cf2-6abe-4ace-bd57-55ce1e237552 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:04.769295 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1ee19cf2-6abe-4ace-bd57-55ce1e237552 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:04.777753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ee19cf2-6abe-4ace-bd57-55ce1e237552 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:04.781023 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ee19cf2-6abe-4ace-bd57-55ce1e237552 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:04.782116 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ee19cf2-6abe-4ace-bd57-55ce1e237552 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:04.782702 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ee19cf2-6abe-4ace-bd57-55ce1e237552 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:04.811476 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] validate_networks() for [('028a45e4-8708-408c-a3b9-d772d5389f9f', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:19:05.261900 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1ee19cf2-6abe-4ace-bd57-55ce1e237552 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:05.276793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1ee19cf2-6abe-4ace-bd57-55ce1e237552 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.513077 Apr 12 16:19:05.288935 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 33/64] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:04 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:05.566882 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-e1898271-2605-445a-b0ba-0f94eac8db97 req-3decde81-dcaa-4ea5-9a82-4be0d813efb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac", "tag": "150e9cf9-34e1-43bb-8678-6b019f683dc6"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:05.578329 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-e1898271-2605-445a-b0ba-0f94eac8db97 req-3decde81-dcaa-4ea5-9a82-4be0d813efb8 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.578977 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-e1898271-2605-445a-b0ba-0f94eac8db97 req-3decde81-dcaa-4ea5-9a82-4be0d813efb8 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.600030 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-e1898271-2605-445a-b0ba-0f94eac8db97 req-3decde81-dcaa-4ea5-9a82-4be0d813efb8 service nova] Creating event network-changed:150e9cf9-34e1-43bb-8678-6b019f683dc6 for instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac on hv-cinder-83752 Apr 12 16:19:05.600568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-e1898271-2605-445a-b0ba-0f94eac8db97 req-3decde81-dcaa-4ea5-9a82-4be0d813efb8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117201) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 12 16:19:05.601861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ab1f206a-07a5-4e89-8613-fde9b051aa36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.602331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ab1f206a-07a5-4e89-8613-fde9b051aa36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.603130 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ab1f206a-07a5-4e89-8613-fde9b051aa36 None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.603568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ab1f206a-07a5-4e89-8613-fde9b051aa36 None None] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.612546 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.compute.rpcapi [None req-ab1f206a-07a5-4e89-8613-fde9b051aa36 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 12 16:19:05.613428 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ab1f206a-07a5-4e89-8613-fde9b051aa36 None None] Releasing lock "compute-rpcapi-router" {{(pid=117201) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 16:19:05.629476 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ab1f206a-07a5-4e89-8613-fde9b051aa36 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267400 Apr 12 16:19:05.630399 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 34/65] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:19:05.635629 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-414da5ab-5996-4a58-82ed-fd8bb499e224 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:05.636628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-414da5ab-5996-4a58-82ed-fd8bb499e224 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:05.643915 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-414da5ab-5996-4a58-82ed-fd8bb499e224 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.644359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-414da5ab-5996-4a58-82ed-fd8bb499e224 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.645771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-414da5ab-5996-4a58-82ed-fd8bb499e224 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.646304 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-414da5ab-5996-4a58-82ed-fd8bb499e224 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.718605 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:19:05.719026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:19:05.719555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:19:05.719960 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:19:05.720367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:19:05.729789 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.730311 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.731200 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.731542 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.752700 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for project 9e274b464718459ea125ef2d5b5003ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:19:05.763370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for user adf30b4421074395b1b70e44bcf6ed10 and project 9e274b464718459ea125ef2d5b5003ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:19:05.779628 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:19:05.785823 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:19:05.837503 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-414da5ab-5996-4a58-82ed-fd8bb499e224 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:05.847064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-414da5ab-5996-4a58-82ed-fd8bb499e224 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.215500 Apr 12 16:19:05.848224 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 35/66] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:05 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:05.861061 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bd9c588e-d013-4fda-ba20-c2b06c745481 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.289006 Apr 12 16:19:05.866902 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 32/67] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:19:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:19:05.867055 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5c971736-c99b-431f-8c17-36ece9add661 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:05.867055 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5c971736-c99b-431f-8c17-36ece9add661 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:05.868064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:05.868742 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:05.871673 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5c971736-c99b-431f-8c17-36ece9add661 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.872285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5c971736-c99b-431f-8c17-36ece9add661 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.873229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5c971736-c99b-431f-8c17-36ece9add661 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.873810 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5c971736-c99b-431f-8c17-36ece9add661 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.875861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.876292 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.877429 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:05.877871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:05.951586 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:05.967962 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:05.970293 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:05.970929 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-af88243a-98f4-4a6a-9fbc-6fc4a1c8b8bf tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1284 microversion: 2.20 time: 0.107883 Apr 12 16:19:05.991844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 33/68] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:05 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:05.997206 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-42b50c0a-2b4b-4693-8f72-a4ff03121179 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:05.997985 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-42b50c0a-2b4b-4693-8f72-a4ff03121179 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:06.005933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5c971736-c99b-431f-8c17-36ece9add661 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:06.018895 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5c971736-c99b-431f-8c17-36ece9add661 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1272 microversion: 2.1 time: 0.168881 Apr 12 16:19:06.022921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 36/69] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:05 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:06.065520 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-42b50c0a-2b4b-4693-8f72-a4ff03121179 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:06.073735 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-42b50c0a-2b4b-4693-8f72-a4ff03121179 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1237 microversion: 2.1 time: 0.080669 Apr 12 16:19:06.082670 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 34/70] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:05 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:06.294897 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-deacc4b3-ad44-4fad-a381-d2e30a134500 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:06.295517 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-deacc4b3-ad44-4fad-a381-d2e30a134500 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:06.316342 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-deacc4b3-ad44-4fad-a381-d2e30a134500 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:06.316825 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-deacc4b3-ad44-4fad-a381-d2e30a134500 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:06.317999 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-deacc4b3-ad44-4fad-a381-d2e30a134500 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:06.318522 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-deacc4b3-ad44-4fad-a381-d2e30a134500 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:06.869522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a0f2ef80-ee62-4ed5-b6af-0b3257500295 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:06.869522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a0f2ef80-ee62-4ed5-b6af-0b3257500295 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:06.892881 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef80-ee62-4ed5-b6af-0b3257500295 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:06.893336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef80-ee62-4ed5-b6af-0b3257500295 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:06.894156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef80-ee62-4ed5-b6af-0b3257500295 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:06.894593 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef80-ee62-4ed5-b6af-0b3257500295 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:07.281260 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a0f2ef80-ee62-4ed5-b6af-0b3257500295 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:07.296825 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a0f2ef80-ee62-4ed5-b6af-0b3257500295 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.435574 Apr 12 16:19:07.297340 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 35/71] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:06 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:07.302369 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:07.312627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:07.321742 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:07.325614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:07.326900 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:07.327799 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:07.486580 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:07.497107 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:07.498664 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:07.508866 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3e96ca8f-96e6-42fb-8be2-f99cdbb7b562 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1332 microversion: 2.20 time: 0.210279 Apr 12 16:19:07.509693 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 36/72] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:07 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1332 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:07.515393 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f7457c1f-7cff-4621-81b2-f7c1143d42cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:07.518676 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f7457c1f-7cff-4621-81b2-f7c1143d42cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:07.530239 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f7457c1f-7cff-4621-81b2-f7c1143d42cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:07.530874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f7457c1f-7cff-4621-81b2-f7c1143d42cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:07.531882 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f7457c1f-7cff-4621-81b2-f7c1143d42cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:07.532806 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f7457c1f-7cff-4621-81b2-f7c1143d42cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:07.659436 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-deacc4b3-ad44-4fad-a381-d2e30a134500 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:07.674427 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-deacc4b3-ad44-4fad-a381-d2e30a134500 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 1.383834 Apr 12 16:19:07.681186 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 37/73] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:06 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:07.688454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ea4bb83f-3f51-443f-b5a0-dcaaed1eb8cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:07.689168 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ea4bb83f-3f51-443f-b5a0-dcaaed1eb8cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:07.695549 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ea4bb83f-3f51-443f-b5a0-dcaaed1eb8cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:07.695988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ea4bb83f-3f51-443f-b5a0-dcaaed1eb8cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:07.696919 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ea4bb83f-3f51-443f-b5a0-dcaaed1eb8cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:07.697532 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ea4bb83f-3f51-443f-b5a0-dcaaed1eb8cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:07.719643 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f7457c1f-7cff-4621-81b2-f7c1143d42cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:07.735483 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f7457c1f-7cff-4621-81b2-f7c1143d42cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1278 microversion: 2.1 time: 0.223632 Apr 12 16:19:07.742582 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 37/74] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:07 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:07.810276 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ea4bb83f-3f51-443f-b5a0-dcaaed1eb8cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:07.822263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ea4bb83f-3f51-443f-b5a0-dcaaed1eb8cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1289 microversion: 2.1 time: 0.136984 Apr 12 16:19:07.825865 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 38/75] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:07 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1289 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:08.313866 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-90df882e-9b08-48d4-a746-f0b7f0b38f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:08.314451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-90df882e-9b08-48d4-a746-f0b7f0b38f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:08.336332 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90df882e-9b08-48d4-a746-f0b7f0b38f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:08.336968 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90df882e-9b08-48d4-a746-f0b7f0b38f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:08.337939 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90df882e-9b08-48d4-a746-f0b7f0b38f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:08.340748 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90df882e-9b08-48d4-a746-f0b7f0b38f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:08.530416 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:08.531399 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:08.544550 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:08.545003 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:08.545782 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:08.546258 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:08.898377 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:08.910820 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:08.914615 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:08.918129 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-944edeec-460b-49ef-ad99-c91c334ec288 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1338 microversion: 2.20 time: 0.391863 Apr 12 16:19:08.918707 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 39/76] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:08 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1338 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:19:08.931327 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-665e6a07-4af5-49b7-8cba-222e6a1da873 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:08.935484 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-665e6a07-4af5-49b7-8cba-222e6a1da873 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:08.949195 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-665e6a07-4af5-49b7-8cba-222e6a1da873 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:08.950573 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-665e6a07-4af5-49b7-8cba-222e6a1da873 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:08.954679 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-665e6a07-4af5-49b7-8cba-222e6a1da873 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:08.957443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-665e6a07-4af5-49b7-8cba-222e6a1da873 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:09.522098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-90df882e-9b08-48d4-a746-f0b7f0b38f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:09.534151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-90df882e-9b08-48d4-a746-f0b7f0b38f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 1.224417 Apr 12 16:19:09.535946 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 38/77] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:08 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:09.540772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-725fd6b3-f1a1-4935-be73-bce3da915d5b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:09.541542 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-725fd6b3-f1a1-4935-be73-bce3da915d5b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:09.548387 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-725fd6b3-f1a1-4935-be73-bce3da915d5b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:09.549151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-725fd6b3-f1a1-4935-be73-bce3da915d5b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:09.550138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-725fd6b3-f1a1-4935-be73-bce3da915d5b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:09.551136 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-725fd6b3-f1a1-4935-be73-bce3da915d5b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:09.850464 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-665e6a07-4af5-49b7-8cba-222e6a1da873 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:09.858867 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-665e6a07-4af5-49b7-8cba-222e6a1da873 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.938907 Apr 12 16:19:09.859676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 40/78] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:08 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:09.864395 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c459f3d7-bbec-4b10-aa93-c45078f4aade tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:09.870104 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c459f3d7-bbec-4b10-aa93-c45078f4aade tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:09.877887 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c459f3d7-bbec-4b10-aa93-c45078f4aade tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:09.878576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c459f3d7-bbec-4b10-aa93-c45078f4aade tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:09.880368 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c459f3d7-bbec-4b10-aa93-c45078f4aade tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:09.881037 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c459f3d7-bbec-4b10-aa93-c45078f4aade tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:10.052640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c459f3d7-bbec-4b10-aa93-c45078f4aade tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:10.072295 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c459f3d7-bbec-4b10-aa93-c45078f4aade tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1295 microversion: 2.1 time: 0.210733 Apr 12 16:19:10.073958 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 41/79] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:09 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1295 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:10.156171 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-725fd6b3-f1a1-4935-be73-bce3da915d5b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:10.173158 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-725fd6b3-f1a1-4935-be73-bce3da915d5b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.635969 Apr 12 16:19:10.178944 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 39/80] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:09 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:10.183194 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-992f1813-83b1-4564-8d8b-2c1b42f8a22e req-140cb379-9d32-48e0-877f-0945a93d4799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487aea79-f1c3-4ab8-9d49-cee300992479", "name": "network-vif-plugged", "status": "completed", "tag": "f139bb8c-aace-4035-a88f-6180d6399d1b"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:10.186566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:10.187959 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:10.204912 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:10.205360 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-992f1813-83b1-4564-8d8b-2c1b42f8a22e req-140cb379-9d32-48e0-877f-0945a93d4799 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:10.205496 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:10.205879 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-992f1813-83b1-4564-8d8b-2c1b42f8a22e req-140cb379-9d32-48e0-877f-0945a93d4799 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:10.206624 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:10.207051 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:10.220570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-992f1813-83b1-4564-8d8b-2c1b42f8a22e req-140cb379-9d32-48e0-877f-0945a93d4799 service nova] Creating event network-vif-plugged:f139bb8c-aace-4035-a88f-6180d6399d1b for instance 487aea79-f1c3-4ab8-9d49-cee300992479 on hv-cinder-83752 Apr 12 16:19:10.227943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-992f1813-83b1-4564-8d8b-2c1b42f8a22e req-140cb379-9d32-48e0-877f-0945a93d4799 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151987 Apr 12 16:19:10.230794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 42/81] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:10.316792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-39673a40-2f09-4065-8d7f-d14cd27c451d req-4045838d-e267-44e7-8ce6-d0baeabf5005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d84741a-a53e-484d-b7c1-77df2336fa27", "tag": "2b4a5c66-664f-4c45-97da-99ed8c2f0118"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:10.331077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-39673a40-2f09-4065-8d7f-d14cd27c451d req-4045838d-e267-44e7-8ce6-d0baeabf5005 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:10.332427 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-39673a40-2f09-4065-8d7f-d14cd27c451d req-4045838d-e267-44e7-8ce6-d0baeabf5005 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:10.370533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-39673a40-2f09-4065-8d7f-d14cd27c451d req-4045838d-e267-44e7-8ce6-d0baeabf5005 service nova] Creating event network-changed:2b4a5c66-664f-4c45-97da-99ed8c2f0118 for instance 5d84741a-a53e-484d-b7c1-77df2336fa27 on hv-cinder-83752 Apr 12 16:19:10.380085 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-39673a40-2f09-4065-8d7f-d14cd27c451d req-4045838d-e267-44e7-8ce6-d0baeabf5005 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067617 Apr 12 16:19:10.385508 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 43/82] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:19:10.554332 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1e551be2-4351-4693-a214-ec675a1e0a6b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:10.555301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1e551be2-4351-4693-a214-ec675a1e0a6b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:10.564612 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1e551be2-4351-4693-a214-ec675a1e0a6b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:10.565128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1e551be2-4351-4693-a214-ec675a1e0a6b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:10.565970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1e551be2-4351-4693-a214-ec675a1e0a6b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:10.566546 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1e551be2-4351-4693-a214-ec675a1e0a6b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:10.599908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:10.607824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:10.609331 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:10.610477 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e97076da-f2ad-45b7-ac64-9cfb069ff27d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.429341 Apr 12 16:19:10.611271 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 40/83] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:10 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:10.894527 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1e551be2-4351-4693-a214-ec675a1e0a6b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:10.900065 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0516c356-36dd-49e6-8fcf-e4af7dd01fdd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:10.902434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0516c356-36dd-49e6-8fcf-e4af7dd01fdd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:10.904889 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1e551be2-4351-4693-a214-ec675a1e0a6b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.356723 Apr 12 16:19:10.905885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 44/84] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:10 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:10.924990 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0516c356-36dd-49e6-8fcf-e4af7dd01fdd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:10.926365 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0516c356-36dd-49e6-8fcf-e4af7dd01fdd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:10.930928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0516c356-36dd-49e6-8fcf-e4af7dd01fdd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:10.932085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0516c356-36dd-49e6-8fcf-e4af7dd01fdd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.092855 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-202fc178-967b-4fd4-8b40-3809a85e607e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:11.093626 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-202fc178-967b-4fd4-8b40-3809a85e607e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:11.099974 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-202fc178-967b-4fd4-8b40-3809a85e607e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.100552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-202fc178-967b-4fd4-8b40-3809a85e607e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.101570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-202fc178-967b-4fd4-8b40-3809a85e607e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.102192 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-202fc178-967b-4fd4-8b40-3809a85e607e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.209127 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0516c356-36dd-49e6-8fcf-e4af7dd01fdd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:11.216643 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0516c356-36dd-49e6-8fcf-e4af7dd01fdd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.343953 Apr 12 16:19:11.217225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 41/85] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:10 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:11.230489 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9c523f42-76ca-46ad-9465-14f3be8698b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:11.231231 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9c523f42-76ca-46ad-9465-14f3be8698b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:11.239081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9c523f42-76ca-46ad-9465-14f3be8698b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.240594 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9c523f42-76ca-46ad-9465-14f3be8698b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.243154 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9c523f42-76ca-46ad-9465-14f3be8698b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.246763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9c523f42-76ca-46ad-9465-14f3be8698b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.366422 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-202fc178-967b-4fd4-8b40-3809a85e607e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:11.377245 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-202fc178-967b-4fd4-8b40-3809a85e607e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.289944 Apr 12 16:19:11.377820 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 45/86] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:11 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:11.384080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-f6dcc029-d31c-45fc-941b-ba9e4191d510 req-1672ca68-3939-4292-b730-8729fc7c66b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e6a8f9-e6af-4d52-9722-25d9de08e9b5", "tag": "1482398b-faf8-483e-b85f-481978b24399"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:11.422248 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-f6dcc029-d31c-45fc-941b-ba9e4191d510 req-1672ca68-3939-4292-b730-8729fc7c66b5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.424828 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-f6dcc029-d31c-45fc-941b-ba9e4191d510 req-1672ca68-3939-4292-b730-8729fc7c66b5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.450854 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-f6dcc029-d31c-45fc-941b-ba9e4191d510 req-1672ca68-3939-4292-b730-8729fc7c66b5 service nova] Creating event network-changed:1482398b-faf8-483e-b85f-481978b24399 for instance f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 on hv-cinder-83752 Apr 12 16:19:11.459388 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-f6dcc029-d31c-45fc-941b-ba9e4191d510 req-1672ca68-3939-4292-b730-8729fc7c66b5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079769 Apr 12 16:19:11.460186 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 46/87] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:11.488811 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9c523f42-76ca-46ad-9465-14f3be8698b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:11.497802 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9c523f42-76ca-46ad-9465-14f3be8698b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.279379 Apr 12 16:19:11.498554 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 42/88] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:11 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:11.638299 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:11.639180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:11.645231 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.645938 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.646778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.647357 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.776379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:11.784345 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:11.785904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:11.787013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9719242a-8a8b-4c06-8bc2-2ae5f822ab6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.161946 Apr 12 16:19:11.787568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 47/89] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:11 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:11.922527 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9edd1c48-58f8-4eb5-97e7-008f4fcb55aa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:11.923204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9edd1c48-58f8-4eb5-97e7-008f4fcb55aa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:11.929348 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9edd1c48-58f8-4eb5-97e7-008f4fcb55aa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.929900 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9edd1c48-58f8-4eb5-97e7-008f4fcb55aa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:11.930691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9edd1c48-58f8-4eb5-97e7-008f4fcb55aa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:11.931118 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9edd1c48-58f8-4eb5-97e7-008f4fcb55aa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.067921 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9edd1c48-58f8-4eb5-97e7-008f4fcb55aa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:12.075443 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9edd1c48-58f8-4eb5-97e7-008f4fcb55aa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.157481 Apr 12 16:19:12.076001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 43/90] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:11 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:12.233145 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b58e2560-101f-4955-9e29-d4294422f21c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:12.233827 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b58e2560-101f-4955-9e29-d4294422f21c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:12.240107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b58e2560-101f-4955-9e29-d4294422f21c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:12.240624 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b58e2560-101f-4955-9e29-d4294422f21c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.241465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b58e2560-101f-4955-9e29-d4294422f21c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:12.241993 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b58e2560-101f-4955-9e29-d4294422f21c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.378432 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b58e2560-101f-4955-9e29-d4294422f21c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:12.385930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b58e2560-101f-4955-9e29-d4294422f21c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.156769 Apr 12 16:19:12.386552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 48/91] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:12 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:12.397208 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-aed09156-5729-4857-9639-b969ca927124 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:12.397770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-aed09156-5729-4857-9639-b969ca927124 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:12.406090 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aed09156-5729-4857-9639-b969ca927124 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:12.406090 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aed09156-5729-4857-9639-b969ca927124 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.406090 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aed09156-5729-4857-9639-b969ca927124 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:12.406090 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aed09156-5729-4857-9639-b969ca927124 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.514823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6e2e227b-6a35-4d60-aba1-819c3cef1e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:12.515426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6e2e227b-6a35-4d60-aba1-819c3cef1e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:12.521622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6e2e227b-6a35-4d60-aba1-819c3cef1e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:12.522087 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6e2e227b-6a35-4d60-aba1-819c3cef1e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.522862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6e2e227b-6a35-4d60-aba1-819c3cef1e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:12.523288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6e2e227b-6a35-4d60-aba1-819c3cef1e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.546667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-aed09156-5729-4857-9639-b969ca927124 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:12.556519 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-aed09156-5729-4857-9639-b969ca927124 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.163878 Apr 12 16:19:12.562290 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 44/92] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:12 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:12.659126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6e2e227b-6a35-4d60-aba1-819c3cef1e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:12.667858 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6e2e227b-6a35-4d60-aba1-819c3cef1e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.157138 Apr 12 16:19:12.669281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 49/93] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:12 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:12.806213 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:12.806958 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:12.812839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:12.813278 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.814032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:12.814481 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:12.947018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:12.955410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:12.956912 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:12.958360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-29837d9d-fa74-4504-9175-4fbdf66ed809 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.155858 Apr 12 16:19:12.959002 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 45/94] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:12 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:13.095650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2467fb19-feea-4d1b-8ff6-8f64c20cf506 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:13.097228 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2467fb19-feea-4d1b-8ff6-8f64c20cf506 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:13.104530 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2467fb19-feea-4d1b-8ff6-8f64c20cf506 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:13.105241 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2467fb19-feea-4d1b-8ff6-8f64c20cf506 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:13.107282 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2467fb19-feea-4d1b-8ff6-8f64c20cf506 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:13.107945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2467fb19-feea-4d1b-8ff6-8f64c20cf506 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:13.403609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7c750f65-bc45-44a8-97eb-b39675231767 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:13.404229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7c750f65-bc45-44a8-97eb-b39675231767 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:13.421827 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7c750f65-bc45-44a8-97eb-b39675231767 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:13.422303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7c750f65-bc45-44a8-97eb-b39675231767 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:13.423100 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7c750f65-bc45-44a8-97eb-b39675231767 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:13.423538 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7c750f65-bc45-44a8-97eb-b39675231767 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:14.321926 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2467fb19-feea-4d1b-8ff6-8f64c20cf506 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:14.330885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2467fb19-feea-4d1b-8ff6-8f64c20cf506 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 1.241058 Apr 12 16:19:14.332865 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 50/95] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:13 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:14.338872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-28a5e0ca-b5c8-449f-8b87-9d006df5b5ab tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:14.339470 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-28a5e0ca-b5c8-449f-8b87-9d006df5b5ab tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:14.348298 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-28a5e0ca-b5c8-449f-8b87-9d006df5b5ab tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:14.348795 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-28a5e0ca-b5c8-449f-8b87-9d006df5b5ab tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:14.349765 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-28a5e0ca-b5c8-449f-8b87-9d006df5b5ab tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:14.350424 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-28a5e0ca-b5c8-449f-8b87-9d006df5b5ab tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:14.440210 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7c750f65-bc45-44a8-97eb-b39675231767 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:14.456557 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7c750f65-bc45-44a8-97eb-b39675231767 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 1.055696 Apr 12 16:19:14.457988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 46/96] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:13 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:14.464550 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ccd5ecd2-89ea-4082-85d5-99b1db12dda5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:14.465769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ccd5ecd2-89ea-4082-85d5-99b1db12dda5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:14.472862 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ccd5ecd2-89ea-4082-85d5-99b1db12dda5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:14.473445 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ccd5ecd2-89ea-4082-85d5-99b1db12dda5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:14.474550 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ccd5ecd2-89ea-4082-85d5-99b1db12dda5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:14.475059 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ccd5ecd2-89ea-4082-85d5-99b1db12dda5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:14.765275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-28a5e0ca-b5c8-449f-8b87-9d006df5b5ab tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:14.776829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-28a5e0ca-b5c8-449f-8b87-9d006df5b5ab tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.442861 Apr 12 16:19:14.780182 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 51/97] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:14 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:14.797586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:14.798916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:14.806781 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:14.807576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:14.809127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:14.809734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:14.893748 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ccd5ecd2-89ea-4082-85d5-99b1db12dda5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:14.901559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ccd5ecd2-89ea-4082-85d5-99b1db12dda5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.442074 Apr 12 16:19:14.910241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 47/98] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:14 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:14.923628 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-611cced4-af3b-454e-8fec-6cda02f6f30d req-fa22c2d5-1449-4f29-a189-15dab3aa6a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f48c36-5e37-4640-b589-df261265d809", "tag": "aaca632c-41bc-43f8-8889-7aea0e458ffa"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:14.933325 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-611cced4-af3b-454e-8fec-6cda02f6f30d req-fa22c2d5-1449-4f29-a189-15dab3aa6a75 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:14.942305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-611cced4-af3b-454e-8fec-6cda02f6f30d req-fa22c2d5-1449-4f29-a189-15dab3aa6a75 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:14.963047 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-611cced4-af3b-454e-8fec-6cda02f6f30d req-fa22c2d5-1449-4f29-a189-15dab3aa6a75 service nova] Creating event network-changed:aaca632c-41bc-43f8-8889-7aea0e458ffa for instance 29f48c36-5e37-4640-b589-df261265d809 on hv-cinder-83752 Apr 12 16:19:14.970076 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-611cced4-af3b-454e-8fec-6cda02f6f30d req-fa22c2d5-1449-4f29-a189-15dab3aa6a75 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057996 Apr 12 16:19:14.971183 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 48/99] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:15.172060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:15.184255 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:15.194352 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:15.196352 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2292b988-c57e-4c75-b8d7-44c5654e66a2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.414972 Apr 12 16:19:15.208048 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 52/100] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:14 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:15.350371 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9aeedf00-0c3a-45b9-9ab4-84aa2e03a9de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:15.351431 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9aeedf00-0c3a-45b9-9ab4-84aa2e03a9de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:15.357875 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9aeedf00-0c3a-45b9-9ab4-84aa2e03a9de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.358544 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9aeedf00-0c3a-45b9-9ab4-84aa2e03a9de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.359485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9aeedf00-0c3a-45b9-9ab4-84aa2e03a9de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.359910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9aeedf00-0c3a-45b9-9ab4-84aa2e03a9de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.430060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-2fb78ae9-26ca-4ca4-88f3-7a3f31a26127 req-125b6a2d-6c03-4ebf-8d53-f13f0484337a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23749e20-689d-41b3-b798-49c86d90ae20", "tag": "28e64fcd-7b2c-41c0-8cce-a7de7807a101"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:15.442259 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2fb78ae9-26ca-4ca4-88f3-7a3f31a26127 req-125b6a2d-6c03-4ebf-8d53-f13f0484337a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.443000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2fb78ae9-26ca-4ca4-88f3-7a3f31a26127 req-125b6a2d-6c03-4ebf-8d53-f13f0484337a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.466599 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-2fb78ae9-26ca-4ca4-88f3-7a3f31a26127 req-125b6a2d-6c03-4ebf-8d53-f13f0484337a service nova] Creating event network-changed:28e64fcd-7b2c-41c0-8cce-a7de7807a101 for instance 23749e20-689d-41b3-b798-49c86d90ae20 on hv-cinder-83752 Apr 12 16:19:15.479388 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-2fb78ae9-26ca-4ca4-88f3-7a3f31a26127 req-125b6a2d-6c03-4ebf-8d53-f13f0484337a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054307 Apr 12 16:19:15.481588 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 53/101] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:19:15.497521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a74a50cf-573b-472a-9411-781be4ed800b tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:15.498509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a74a50cf-573b-472a-9411-781be4ed800b tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:15.514930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a74a50cf-573b-472a-9411-781be4ed800b tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.517793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a74a50cf-573b-472a-9411-781be4ed800b tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.520125 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a74a50cf-573b-472a-9411-781be4ed800b tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.521603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a74a50cf-573b-472a-9411-781be4ed800b tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.706680 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9aeedf00-0c3a-45b9-9ab4-84aa2e03a9de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:15.718364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9aeedf00-0c3a-45b9-9ab4-84aa2e03a9de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.372658 Apr 12 16:19:15.720446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 49/102] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:15 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:15.795843 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e8418313-8ae4-4757-92ab-a955bf361ea8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:15.796686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e8418313-8ae4-4757-92ab-a955bf361ea8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:15.803517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e8418313-8ae4-4757-92ab-a955bf361ea8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.804383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e8418313-8ae4-4757-92ab-a955bf361ea8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.805349 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e8418313-8ae4-4757-92ab-a955bf361ea8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.805947 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e8418313-8ae4-4757-92ab-a955bf361ea8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.867212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a74a50cf-573b-472a-9411-781be4ed800b tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:15.875379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a74a50cf-573b-472a-9411-781be4ed800b tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.390250 Apr 12 16:19:15.875954 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 54/103] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:15 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:15.927891 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8db704ef-0984-4070-8392-2592b7fda745 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:15.928621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8db704ef-0984-4070-8392-2592b7fda745 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:15.939801 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8db704ef-0984-4070-8392-2592b7fda745 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.941168 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8db704ef-0984-4070-8392-2592b7fda745 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.942568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8db704ef-0984-4070-8392-2592b7fda745 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:15.943399 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8db704ef-0984-4070-8392-2592b7fda745 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:15.977640 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e8418313-8ae4-4757-92ab-a955bf361ea8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:15.985287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e8418313-8ae4-4757-92ab-a955bf361ea8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.193189 Apr 12 16:19:15.996326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 50/104] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:15 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:16.091861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8db704ef-0984-4070-8392-2592b7fda745 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:16.099772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8db704ef-0984-4070-8392-2592b7fda745 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.177343 Apr 12 16:19:16.100351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 55/105] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:15 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:16.216507 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:16.217208 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:16.224537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:16.225525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:16.226806 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:16.227301 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:16.373538 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:16.382270 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:16.383768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:16.384879 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c5b34d4e-12e4-4993-b94f-a7b3e941afa8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.173666 Apr 12 16:19:16.385609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 51/106] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:16 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:16.738090 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-50a13026-2c87-46ad-8f6e-7be38d3b018e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:16.738831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-50a13026-2c87-46ad-8f6e-7be38d3b018e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:16.745398 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-50a13026-2c87-46ad-8f6e-7be38d3b018e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:16.745903 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-50a13026-2c87-46ad-8f6e-7be38d3b018e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:16.746820 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-50a13026-2c87-46ad-8f6e-7be38d3b018e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:16.747310 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-50a13026-2c87-46ad-8f6e-7be38d3b018e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:16.892163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-673c4027-0abd-4763-b233-92b82994fdcb tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:16.892828 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-673c4027-0abd-4763-b233-92b82994fdcb tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:16.895736 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-50a13026-2c87-46ad-8f6e-7be38d3b018e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:16.898986 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-673c4027-0abd-4763-b233-92b82994fdcb tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:16.899424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-673c4027-0abd-4763-b233-92b82994fdcb tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:16.900423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-673c4027-0abd-4763-b233-92b82994fdcb tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:16.901049 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-673c4027-0abd-4763-b233-92b82994fdcb tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:16.907340 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-50a13026-2c87-46ad-8f6e-7be38d3b018e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.174033 Apr 12 16:19:16.908101 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 56/107] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:16 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:17.005854 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-af7c5c72-abb2-4679-aa8a-397f27fbff1d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:17.006500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-af7c5c72-abb2-4679-aa8a-397f27fbff1d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:17.014128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af7c5c72-abb2-4679-aa8a-397f27fbff1d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:17.014814 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af7c5c72-abb2-4679-aa8a-397f27fbff1d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:17.016060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af7c5c72-abb2-4679-aa8a-397f27fbff1d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:17.016641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af7c5c72-abb2-4679-aa8a-397f27fbff1d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:17.040242 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-673c4027-0abd-4763-b233-92b82994fdcb tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:17.048357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-673c4027-0abd-4763-b233-92b82994fdcb tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.159866 Apr 12 16:19:17.058306 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 52/108] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:16 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:17.123701 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-794b323a-fcd6-4516-91f9-498e38950cb8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:17.133319 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-794b323a-fcd6-4516-91f9-498e38950cb8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:17.139829 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-794b323a-fcd6-4516-91f9-498e38950cb8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:17.140281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-794b323a-fcd6-4516-91f9-498e38950cb8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:17.148153 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-794b323a-fcd6-4516-91f9-498e38950cb8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:17.148153 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-794b323a-fcd6-4516-91f9-498e38950cb8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:17.189404 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-af7c5c72-abb2-4679-aa8a-397f27fbff1d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:17.201902 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-af7c5c72-abb2-4679-aa8a-397f27fbff1d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.201200 Apr 12 16:19:17.203735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 57/109] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:16 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:17.295922 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-794b323a-fcd6-4516-91f9-498e38950cb8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:17.304774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-794b323a-fcd6-4516-91f9-498e38950cb8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.185346 Apr 12 16:19:17.305528 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 53/110] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:17 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:17.404682 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:17.405772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:17.412677 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:17.413446 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:17.427833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:17.428293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:17.561325 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:17.569316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:17.570909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:17.572008 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-769ba380-15a3-4dec-8fe6-fc2a01a73898 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.172149 Apr 12 16:19:17.572570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 58/111] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:17 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:17.924606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dde2830a-b709-4097-a5d7-2e13627632f3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:17.925219 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dde2830a-b709-4097-a5d7-2e13627632f3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:17.931716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dde2830a-b709-4097-a5d7-2e13627632f3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:17.932131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dde2830a-b709-4097-a5d7-2e13627632f3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:17.933122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dde2830a-b709-4097-a5d7-2e13627632f3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:17.933515 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dde2830a-b709-4097-a5d7-2e13627632f3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.064844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cff5149f-a3f7-4112-a066-5b9c0e636fad tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:18.065376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-cff5149f-a3f7-4112-a066-5b9c0e636fad tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:18.071960 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cff5149f-a3f7-4112-a066-5b9c0e636fad tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:18.075048 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dde2830a-b709-4097-a5d7-2e13627632f3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:18.075741 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cff5149f-a3f7-4112-a066-5b9c0e636fad tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.076661 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cff5149f-a3f7-4112-a066-5b9c0e636fad tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:18.077099 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cff5149f-a3f7-4112-a066-5b9c0e636fad tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.082547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dde2830a-b709-4097-a5d7-2e13627632f3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.161931 Apr 12 16:19:18.083375 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 54/112] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:17 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:18.215454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-cff5149f-a3f7-4112-a066-5b9c0e636fad tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:18.220191 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4cfed7fe-3062-45f2-8536-647150a30844 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:18.220778 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4cfed7fe-3062-45f2-8536-647150a30844 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:18.223350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-cff5149f-a3f7-4112-a066-5b9c0e636fad tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.162416 Apr 12 16:19:18.223879 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 59/113] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:18 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:18.227803 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4cfed7fe-3062-45f2-8536-647150a30844 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:18.228260 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4cfed7fe-3062-45f2-8536-647150a30844 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.229036 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4cfed7fe-3062-45f2-8536-647150a30844 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:18.229472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4cfed7fe-3062-45f2-8536-647150a30844 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.322286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7655d157-aa80-46a9-a1e1-64d1cea9a8e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:18.322915 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7655d157-aa80-46a9-a1e1-64d1cea9a8e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:18.329582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7655d157-aa80-46a9-a1e1-64d1cea9a8e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:18.330056 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7655d157-aa80-46a9-a1e1-64d1cea9a8e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.330859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7655d157-aa80-46a9-a1e1-64d1cea9a8e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:18.331298 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7655d157-aa80-46a9-a1e1-64d1cea9a8e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.364655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4cfed7fe-3062-45f2-8536-647150a30844 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:18.374630 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4cfed7fe-3062-45f2-8536-647150a30844 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.158259 Apr 12 16:19:18.375580 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 55/114] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:18 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:18.462075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-7655d157-aa80-46a9-a1e1-64d1cea9a8e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:18.469655 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7655d157-aa80-46a9-a1e1-64d1cea9a8e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.151452 Apr 12 16:19:18.470247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 60/115] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:18 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:18.595199 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:18.596033 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:18.603734 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:18.604166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.604910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:18.605338 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:18.733474 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:18.741507 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:18.743010 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:18.744113 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a9b6c3a3-9e69-44f1-9d12-6ee6f9e5622d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.155698 Apr 12 16:19:18.744673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 56/116] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:18 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:19.100591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-053b04dc-e0a2-4cc6-b359-293bf9f4a013 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:19.101243 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-053b04dc-e0a2-4cc6-b359-293bf9f4a013 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:19.109451 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-053b04dc-e0a2-4cc6-b359-293bf9f4a013 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.109906 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-053b04dc-e0a2-4cc6-b359-293bf9f4a013 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.110741 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-053b04dc-e0a2-4cc6-b359-293bf9f4a013 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.111181 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-053b04dc-e0a2-4cc6-b359-293bf9f4a013 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.242173 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-491d5c01-c5ca-48d0-b49f-b031728ebf26 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:19.243245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-491d5c01-c5ca-48d0-b49f-b031728ebf26 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:19.251164 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-491d5c01-c5ca-48d0-b49f-b031728ebf26 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.251837 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-491d5c01-c5ca-48d0-b49f-b031728ebf26 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.252874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-491d5c01-c5ca-48d0-b49f-b031728ebf26 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.253662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-491d5c01-c5ca-48d0-b49f-b031728ebf26 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.393480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-053b04dc-e0a2-4cc6-b359-293bf9f4a013 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:19.401938 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-053b04dc-e0a2-4cc6-b359-293bf9f4a013 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.305512 Apr 12 16:19:19.402463 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 61/117] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:19 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:19.416164 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9a5c0a5f-25a1-4d24-bc6c-8fd8e96ed478 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:19.416805 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9a5c0a5f-25a1-4d24-bc6c-8fd8e96ed478 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:19.428144 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9a5c0a5f-25a1-4d24-bc6c-8fd8e96ed478 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.428613 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9a5c0a5f-25a1-4d24-bc6c-8fd8e96ed478 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.429478 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9a5c0a5f-25a1-4d24-bc6c-8fd8e96ed478 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.429841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9a5c0a5f-25a1-4d24-bc6c-8fd8e96ed478 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.434069 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-491d5c01-c5ca-48d0-b49f-b031728ebf26 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:19.441554 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-491d5c01-c5ca-48d0-b49f-b031728ebf26 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.205050 Apr 12 16:19:19.442541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 57/118] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:19 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:19.490102 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f7530322-76ce-4af1-b7da-8a43bb3f57cf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:19.491335 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f7530322-76ce-4af1-b7da-8a43bb3f57cf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:19.499500 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f7530322-76ce-4af1-b7da-8a43bb3f57cf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.500245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f7530322-76ce-4af1-b7da-8a43bb3f57cf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.501335 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f7530322-76ce-4af1-b7da-8a43bb3f57cf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.502010 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f7530322-76ce-4af1-b7da-8a43bb3f57cf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.932673 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9a5c0a5f-25a1-4d24-bc6c-8fd8e96ed478 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:19.937346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f7530322-76ce-4af1-b7da-8a43bb3f57cf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:19.943592 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9a5c0a5f-25a1-4d24-bc6c-8fd8e96ed478 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.530896 Apr 12 16:19:19.944203 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 62/119] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:19 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:19.948734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:19.949088 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f7530322-76ce-4af1-b7da-8a43bb3f57cf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.463890 Apr 12 16:19:19.949331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:19.949853 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 58/120] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:19 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:19.955632 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.956076 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:19.956844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:19.957263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:20.094401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:20.102804 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:20.104940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:20.106079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-93c4b3d8-89ba-4351-a5a6-47f05dc65758 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.160965 Apr 12 16:19:20.109132 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 63/121] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:19 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:20.419885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3de2caad-41a8-4071-ac1f-4535a0a1b930 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:20.421384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3de2caad-41a8-4071-ac1f-4535a0a1b930 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:20.428205 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3de2caad-41a8-4071-ac1f-4535a0a1b930 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:20.428677 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3de2caad-41a8-4071-ac1f-4535a0a1b930 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:20.429541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3de2caad-41a8-4071-ac1f-4535a0a1b930 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:20.430071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3de2caad-41a8-4071-ac1f-4535a0a1b930 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:20.459485 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c03b4402-17d1-4948-b3b1-b5a07f07676e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:20.460098 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c03b4402-17d1-4948-b3b1-b5a07f07676e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:20.466556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c03b4402-17d1-4948-b3b1-b5a07f07676e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:20.467012 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c03b4402-17d1-4948-b3b1-b5a07f07676e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:20.467791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c03b4402-17d1-4948-b3b1-b5a07f07676e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:20.468231 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c03b4402-17d1-4948-b3b1-b5a07f07676e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:20.607386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3de2caad-41a8-4071-ac1f-4535a0a1b930 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:20.616051 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3de2caad-41a8-4071-ac1f-4535a0a1b930 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.200336 Apr 12 16:19:20.616679 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 59/122] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:20 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:20.637147 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c03b4402-17d1-4948-b3b1-b5a07f07676e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:20.647251 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c03b4402-17d1-4948-b3b1-b5a07f07676e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1315 microversion: 2.1 time: 0.191439 Apr 12 16:19:20.648285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 64/123] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:20 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:20.962759 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f1ff62bf-887c-4c4b-a009-7d43abb53401 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:20.963756 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f1ff62bf-887c-4c4b-a009-7d43abb53401 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:20.967583 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f8f4950d-f123-4860-a665-6ef2a7ab69c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:20.968116 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f8f4950d-f123-4860-a665-6ef2a7ab69c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:20.972224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f1ff62bf-887c-4c4b-a009-7d43abb53401 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:20.974567 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f1ff62bf-887c-4c4b-a009-7d43abb53401 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:20.974850 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f8f4950d-f123-4860-a665-6ef2a7ab69c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:20.975512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f8f4950d-f123-4860-a665-6ef2a7ab69c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:20.977689 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f8f4950d-f123-4860-a665-6ef2a7ab69c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:20.978169 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f8f4950d-f123-4860-a665-6ef2a7ab69c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.006067 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f1ff62bf-887c-4c4b-a009-7d43abb53401 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:21.009115 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f1ff62bf-887c-4c4b-a009-7d43abb53401 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.305686 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f8f4950d-f123-4860-a665-6ef2a7ab69c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:21.313344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f8f4950d-f123-4860-a665-6ef2a7ab69c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.350109 Apr 12 16:19:21.313909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 65/124] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:20 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:21.319282 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:21.320136 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:21.330777 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:21.331500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.332825 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:21.333252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.344558 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f1ff62bf-887c-4c4b-a009-7d43abb53401 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:21.353851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f1ff62bf-887c-4c4b-a009-7d43abb53401 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.396762 Apr 12 16:19:21.363101 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 60/125] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:20 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:21.363101 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-b9fe92db-2cb8-4616-a6af-7c2c10ecb6cc req-87245027-dcac-43b5-93db-d8bf5dcfc504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac", "name": "network-vif-plugged", "status": "completed", "tag": "150e9cf9-34e1-43bb-8678-6b019f683dc6"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:21.370316 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b9fe92db-2cb8-4616-a6af-7c2c10ecb6cc req-87245027-dcac-43b5-93db-d8bf5dcfc504 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:21.370763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b9fe92db-2cb8-4616-a6af-7c2c10ecb6cc req-87245027-dcac-43b5-93db-d8bf5dcfc504 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.402376 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-b9fe92db-2cb8-4616-a6af-7c2c10ecb6cc req-87245027-dcac-43b5-93db-d8bf5dcfc504 service nova] Creating event network-vif-plugged:150e9cf9-34e1-43bb-8678-6b019f683dc6 for instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac on hv-cinder-83752 Apr 12 16:19:21.410608 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-b9fe92db-2cb8-4616-a6af-7c2c10ecb6cc req-87245027-dcac-43b5-93db-d8bf5dcfc504 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054287 Apr 12 16:19:21.411774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 61/126] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:21.502546 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:21.512051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:21.513547 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:21.514777 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c997ce76-48f0-42e5-9268-e4fa62c1f9d4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.199757 Apr 12 16:19:21.515410 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 66/127] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:21 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:21.635959 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3d187263-3b9c-40bb-abd2-822f1067a7cb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:21.636925 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3d187263-3b9c-40bb-abd2-822f1067a7cb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:21.643746 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d187263-3b9c-40bb-abd2-822f1067a7cb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:21.644254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d187263-3b9c-40bb-abd2-822f1067a7cb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.645466 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d187263-3b9c-40bb-abd2-822f1067a7cb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:21.646260 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d187263-3b9c-40bb-abd2-822f1067a7cb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.673660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0e7ae564-3cdb-4827-bc9e-ba77c2c6d92f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:21.682546 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0e7ae564-3cdb-4827-bc9e-ba77c2c6d92f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:21.691651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0e7ae564-3cdb-4827-bc9e-ba77c2c6d92f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:21.692820 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0e7ae564-3cdb-4827-bc9e-ba77c2c6d92f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.694527 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0e7ae564-3cdb-4827-bc9e-ba77c2c6d92f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:21.695193 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0e7ae564-3cdb-4827-bc9e-ba77c2c6d92f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:21.896819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3d187263-3b9c-40bb-abd2-822f1067a7cb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:21.905525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3d187263-3b9c-40bb-abd2-822f1067a7cb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.275792 Apr 12 16:19:21.909064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0e7ae564-3cdb-4827-bc9e-ba77c2c6d92f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:21.919279 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 62/128] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:21 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:21.920356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0e7ae564-3cdb-4827-bc9e-ba77c2c6d92f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1501 microversion: 2.1 time: 0.255295 Apr 12 16:19:21.920984 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 67/129] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:21 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:22.331871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6b6a211f-f6f3-4277-8d8f-8ff75dc3d7e4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:22.332481 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6b6a211f-f6f3-4277-8d8f-8ff75dc3d7e4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:22.338515 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b6a211f-f6f3-4277-8d8f-8ff75dc3d7e4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:22.339032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b6a211f-f6f3-4277-8d8f-8ff75dc3d7e4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:22.339892 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b6a211f-f6f3-4277-8d8f-8ff75dc3d7e4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:22.340386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b6a211f-f6f3-4277-8d8f-8ff75dc3d7e4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:22.372549 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-534466c9-3547-4042-ac6e-dca34cd01d30 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:22.373210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-534466c9-3547-4042-ac6e-dca34cd01d30 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:22.379331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-534466c9-3547-4042-ac6e-dca34cd01d30 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:22.380009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-534466c9-3547-4042-ac6e-dca34cd01d30 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:22.380875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-534466c9-3547-4042-ac6e-dca34cd01d30 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:22.381309 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-534466c9-3547-4042-ac6e-dca34cd01d30 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:22.531313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6b6a211f-f6f3-4277-8d8f-8ff75dc3d7e4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:22.539109 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6b6a211f-f6f3-4277-8d8f-8ff75dc3d7e4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.211447 Apr 12 16:19:22.539685 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 63/130] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:22 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:22.553907 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:22.554540 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:22.555376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-534466c9-3547-4042-ac6e-dca34cd01d30 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:22.561399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:22.562096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:22.562878 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:22.563380 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-534466c9-3547-4042-ac6e-dca34cd01d30 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.196069 Apr 12 16:19:22.563499 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:22.564441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 68/131] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:22 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:22.708802 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:22.717192 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:22.718718 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:22.719855 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ff9dfbb8-d24d-4f8e-bea3-2e107c0a0169 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.170390 Apr 12 16:19:22.720417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 64/132] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:22 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:22.926889 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d10bb1ef-c0d9-4ecb-811f-b00504ffacbe tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:22.927738 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d10bb1ef-c0d9-4ecb-811f-b00504ffacbe tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:22.943577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d10bb1ef-c0d9-4ecb-811f-b00504ffacbe tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:22.947074 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d10bb1ef-c0d9-4ecb-811f-b00504ffacbe tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:22.949109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d10bb1ef-c0d9-4ecb-811f-b00504ffacbe tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:22.949641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d10bb1ef-c0d9-4ecb-811f-b00504ffacbe tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:23.099947 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d10bb1ef-c0d9-4ecb-811f-b00504ffacbe tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:23.117768 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d10bb1ef-c0d9-4ecb-811f-b00504ffacbe tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.194648 Apr 12 16:19:23.118622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 69/133] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:22 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:23.362139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8f25e958-842f-476e-b081-bd03269e8d5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1de8a78e-6ece-43ca-83d2-70ca657f4853"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:23.364806 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8f25e958-842f-476e-b081-bd03269e8d5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:23.374071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8f25e958-842f-476e-b081-bd03269e8d5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:23.374757 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8f25e958-842f-476e-b081-bd03269e8d5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:23.375745 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8f25e958-842f-476e-b081-bd03269e8d5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:23.376528 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8f25e958-842f-476e-b081-bd03269e8d5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:23.556406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8999bc5a-d9d0-461a-9e67-876b679e0b7a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:23.557651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8999bc5a-d9d0-461a-9e67-876b679e0b7a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:23.570303 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8999bc5a-d9d0-461a-9e67-876b679e0b7a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:23.573715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8999bc5a-d9d0-461a-9e67-876b679e0b7a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:23.578699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8999bc5a-d9d0-461a-9e67-876b679e0b7a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:23.582328 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8999bc5a-d9d0-461a-9e67-876b679e0b7a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:23.807410 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8999bc5a-d9d0-461a-9e67-876b679e0b7a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:23.821778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8999bc5a-d9d0-461a-9e67-876b679e0b7a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.269957 Apr 12 16:19:23.826078 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 70/134] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:23 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:23.834721 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a2f6be36-aa18-47fa-8f24-a22d30ba6752 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:23.839970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a2f6be36-aa18-47fa-8f24-a22d30ba6752 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:23.856218 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2f6be36-aa18-47fa-8f24-a22d30ba6752 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:23.856882 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2f6be36-aa18-47fa-8f24-a22d30ba6752 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:23.857845 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2f6be36-aa18-47fa-8f24-a22d30ba6752 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:23.858482 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2f6be36-aa18-47fa-8f24-a22d30ba6752 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:24.174967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a2f6be36-aa18-47fa-8f24-a22d30ba6752 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:24.184844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a2f6be36-aa18-47fa-8f24-a22d30ba6752 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.357029 Apr 12 16:19:24.185352 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 71/135] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:23 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:24.191908 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:24.192586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:24.203189 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:24.204053 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:24.206223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:24.206935 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:24.238404 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8f25e958-842f-476e-b081-bd03269e8d5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "POST /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880315 Apr 12 16:19:24.241025 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 65/136] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:19:23 2022] POST /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:24.260461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cec57ba6-faa1-498b-afa7-0305bdea8c7d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:24.261456 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cec57ba6-faa1-498b-afa7-0305bdea8c7d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:24.271996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cec57ba6-faa1-498b-afa7-0305bdea8c7d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:24.272718 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cec57ba6-faa1-498b-afa7-0305bdea8c7d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:24.273668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cec57ba6-faa1-498b-afa7-0305bdea8c7d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:24.274433 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cec57ba6-faa1-498b-afa7-0305bdea8c7d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:24.666246 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:24.679560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:24.685148 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:24.686560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ebe7be40-3538-4439-9dfe-b8fa242241d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.500078 Apr 12 16:19:24.687276 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 72/137] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:24 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:24.774064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cec57ba6-faa1-498b-afa7-0305bdea8c7d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:24.790699 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cec57ba6-faa1-498b-afa7-0305bdea8c7d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.547394 Apr 12 16:19:24.791719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 66/138] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:24 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:24.844661 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-49f0dff7-4b89-4039-bd7b-aee70e6252e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:24.845379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-49f0dff7-4b89-4039-bd7b-aee70e6252e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:24.858102 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-49f0dff7-4b89-4039-bd7b-aee70e6252e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:24.860614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-49f0dff7-4b89-4039-bd7b-aee70e6252e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:24.861501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-49f0dff7-4b89-4039-bd7b-aee70e6252e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:24.862994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-49f0dff7-4b89-4039-bd7b-aee70e6252e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:25.212590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-30c9ee71-04d8-4a8e-86a9-8bd196d50865 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:25.217701 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-30c9ee71-04d8-4a8e-86a9-8bd196d50865 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:25.242303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-30c9ee71-04d8-4a8e-86a9-8bd196d50865 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:25.244422 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-30c9ee71-04d8-4a8e-86a9-8bd196d50865 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:25.245907 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-30c9ee71-04d8-4a8e-86a9-8bd196d50865 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:25.246879 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-30c9ee71-04d8-4a8e-86a9-8bd196d50865 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:25.635040 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-49f0dff7-4b89-4039-bd7b-aee70e6252e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:25.646356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-49f0dff7-4b89-4039-bd7b-aee70e6252e1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.806913 Apr 12 16:19:25.647360 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 73/139] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:24 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:25.653354 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-80529657-b708-451c-b8e0-e80e8d1486cb req-62052c5a-bdee-4c27-a380-f6aab71a9814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d84741a-a53e-484d-b7c1-77df2336fa27", "name": "network-vif-plugged", "status": "completed", "tag": "2b4a5c66-664f-4c45-97da-99ed8c2f0118"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:25.667361 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-80529657-b708-451c-b8e0-e80e8d1486cb req-62052c5a-bdee-4c27-a380-f6aab71a9814 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:25.668513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-80529657-b708-451c-b8e0-e80e8d1486cb req-62052c5a-bdee-4c27-a380-f6aab71a9814 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:25.685277 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-80529657-b708-451c-b8e0-e80e8d1486cb req-62052c5a-bdee-4c27-a380-f6aab71a9814 service nova] Creating event network-vif-plugged:2b4a5c66-664f-4c45-97da-99ed8c2f0118 for instance 5d84741a-a53e-484d-b7c1-77df2336fa27 on hv-cinder-83752 Apr 12 16:19:25.691292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-80529657-b708-451c-b8e0-e80e8d1486cb req-62052c5a-bdee-4c27-a380-f6aab71a9814 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041885 Apr 12 16:19:25.692138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 74/140] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:25.707319 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:25.708243 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:25.716288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:25.716830 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:25.717787 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:25.718360 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:25.731672 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-30c9ee71-04d8-4a8e-86a9-8bd196d50865 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:25.742745 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-30c9ee71-04d8-4a8e-86a9-8bd196d50865 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.544976 Apr 12 16:19:25.743312 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 67/141] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:25 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:25.812217 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-65acaeca-a8ae-4208-938f-0d8af7ee36f1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:25.812832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-65acaeca-a8ae-4208-938f-0d8af7ee36f1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:25.830381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65acaeca-a8ae-4208-938f-0d8af7ee36f1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:25.832854 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65acaeca-a8ae-4208-938f-0d8af7ee36f1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:25.837135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65acaeca-a8ae-4208-938f-0d8af7ee36f1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:25.837589 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65acaeca-a8ae-4208-938f-0d8af7ee36f1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:26.007195 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:26.021573 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:26.023509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:26.025086 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a37d0bec-7fc7-45c2-b83a-0664e27b7f12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.322524 Apr 12 16:19:26.026262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 75/142] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:25 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:19:26.064332 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-65acaeca-a8ae-4208-938f-0d8af7ee36f1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:26.075440 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-65acaeca-a8ae-4208-938f-0d8af7ee36f1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1363 microversion: 2.1 time: 0.267030 Apr 12 16:19:26.086452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 68/143] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:25 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:26.663337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b82905f4-fe65-4b6e-a2fc-601db3d22c33 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:26.664223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b82905f4-fe65-4b6e-a2fc-601db3d22c33 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:26.679715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b82905f4-fe65-4b6e-a2fc-601db3d22c33 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:26.680377 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b82905f4-fe65-4b6e-a2fc-601db3d22c33 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:26.680934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b82905f4-fe65-4b6e-a2fc-601db3d22c33 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:26.681511 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b82905f4-fe65-4b6e-a2fc-601db3d22c33 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:26.765022 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3d9d77f8-0061-465c-90d6-7e6f31777d6b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:26.765642 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3d9d77f8-0061-465c-90d6-7e6f31777d6b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:26.801622 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d9d77f8-0061-465c-90d6-7e6f31777d6b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:26.802323 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d9d77f8-0061-465c-90d6-7e6f31777d6b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:26.803121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d9d77f8-0061-465c-90d6-7e6f31777d6b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:26.803720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d9d77f8-0061-465c-90d6-7e6f31777d6b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:26.925987 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b82905f4-fe65-4b6e-a2fc-601db3d22c33 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:26.936999 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b82905f4-fe65-4b6e-a2fc-601db3d22c33 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.276320 Apr 12 16:19:26.937557 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 76/144] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:26 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:27.022750 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3d9d77f8-0061-465c-90d6-7e6f31777d6b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:27.032202 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3d9d77f8-0061-465c-90d6-7e6f31777d6b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.276165 Apr 12 16:19:27.039930 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 69/145] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:26 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:27.053126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:27.054001 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:27.060995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.061683 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:27.062626 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.063195 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:27.093884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9dfe47d9-9f64-4ccb-becb-61549f8e3b7f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:27.094598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9dfe47d9-9f64-4ccb-becb-61549f8e3b7f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:27.107399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9dfe47d9-9f64-4ccb-becb-61549f8e3b7f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.107853 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9dfe47d9-9f64-4ccb-becb-61549f8e3b7f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:27.108644 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9dfe47d9-9f64-4ccb-becb-61549f8e3b7f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.109072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9dfe47d9-9f64-4ccb-becb-61549f8e3b7f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:27.425830 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9dfe47d9-9f64-4ccb-becb-61549f8e3b7f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:27.426296 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:27.455019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9dfe47d9-9f64-4ccb-becb-61549f8e3b7f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1554 microversion: 2.1 time: 0.365882 Apr 12 16:19:27.458188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:27.461434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 70/146] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:27 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1554 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:27.463638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:27.465094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8bde7e3a-7b44-409d-97e6-f06c8ac5b68d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.425351 Apr 12 16:19:27.466186 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 77/147] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:27 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:19:27.487475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-26095c5e-9376-4e5c-9b81-ac1382a42f1e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:27.488260 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-26095c5e-9376-4e5c-9b81-ac1382a42f1e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:27.498250 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-26095c5e-9376-4e5c-9b81-ac1382a42f1e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.498966 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-26095c5e-9376-4e5c-9b81-ac1382a42f1e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:27.500047 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-26095c5e-9376-4e5c-9b81-ac1382a42f1e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.500850 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-26095c5e-9376-4e5c-9b81-ac1382a42f1e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:27.636262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-26095c5e-9376-4e5c-9b81-ac1382a42f1e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157336 Apr 12 16:19:27.637232 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 71/148] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Apr 12 16:19:27 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:27.712253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-295cd658-ab7c-44a9-88d8-160cf042765d req-905ab2fd-10e4-4751-b093-ccaa0b3e2dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e6a8f9-e6af-4d52-9722-25d9de08e9b5", "name": "network-vif-plugged", "status": "completed", "tag": "1482398b-faf8-483e-b85f-481978b24399"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:27.722179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-295cd658-ab7c-44a9-88d8-160cf042765d req-905ab2fd-10e4-4751-b093-ccaa0b3e2dee service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.722903 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-295cd658-ab7c-44a9-88d8-160cf042765d req-905ab2fd-10e4-4751-b093-ccaa0b3e2dee service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:27.740735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-295cd658-ab7c-44a9-88d8-160cf042765d req-905ab2fd-10e4-4751-b093-ccaa0b3e2dee service nova] Creating event network-vif-plugged:1482398b-faf8-483e-b85f-481978b24399 for instance f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 on hv-cinder-83752 Apr 12 16:19:27.747501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-295cd658-ab7c-44a9-88d8-160cf042765d req-905ab2fd-10e4-4751-b093-ccaa0b3e2dee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039391 Apr 12 16:19:27.748664 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 78/149] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:27.957469 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1cff6186-73f5-48e0-87c2-ccdedb4e8760 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:27.958153 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1cff6186-73f5-48e0-87c2-ccdedb4e8760 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:27.966932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1cff6186-73f5-48e0-87c2-ccdedb4e8760 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.967377 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1cff6186-73f5-48e0-87c2-ccdedb4e8760 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:27.968142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1cff6186-73f5-48e0-87c2-ccdedb4e8760 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:27.978800 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1cff6186-73f5-48e0-87c2-ccdedb4e8760 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:28.058009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d9bd430c-8998-4406-a596-24b62cee2dd4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:28.060139 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d9bd430c-8998-4406-a596-24b62cee2dd4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:28.077071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d9bd430c-8998-4406-a596-24b62cee2dd4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:28.077723 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d9bd430c-8998-4406-a596-24b62cee2dd4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:28.079108 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d9bd430c-8998-4406-a596-24b62cee2dd4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:28.079720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d9bd430c-8998-4406-a596-24b62cee2dd4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:28.816613 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1cff6186-73f5-48e0-87c2-ccdedb4e8760 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:28.827290 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1cff6186-73f5-48e0-87c2-ccdedb4e8760 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.874675 Apr 12 16:19:28.838437 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 72/150] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:27 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:28.850258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:28.851139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:28.863707 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:28.864485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:28.865744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:28.866399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:29.061651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d9bd430c-8998-4406-a596-24b62cee2dd4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:29.069684 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d9bd430c-8998-4406-a596-24b62cee2dd4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 1.016524 Apr 12 16:19:29.072533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 79/151] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:28 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:29.849537 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c7df3af0-eab0-4707-aa2f-17ca9b169318 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:29.850600 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c7df3af0-eab0-4707-aa2f-17ca9b169318 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:29.861310 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7df3af0-eab0-4707-aa2f-17ca9b169318 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:29.871052 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7df3af0-eab0-4707-aa2f-17ca9b169318 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:29.872179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7df3af0-eab0-4707-aa2f-17ca9b169318 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:29.872819 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7df3af0-eab0-4707-aa2f-17ca9b169318 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:29.878648 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:29.888648 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:29.895746 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:29.897275 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c1cd30a5-427c-4382-9fb6-86ea522b3f89 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 1.057535 Apr 12 16:19:29.904859 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 73/152] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:28 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:30.089016 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-567be708-2208-47ba-ba5c-2b928211926f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:30.089831 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-567be708-2208-47ba-ba5c-2b928211926f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:30.096959 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-567be708-2208-47ba-ba5c-2b928211926f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:30.097632 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-567be708-2208-47ba-ba5c-2b928211926f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:30.098955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-567be708-2208-47ba-ba5c-2b928211926f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:30.099556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-567be708-2208-47ba-ba5c-2b928211926f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:30.372077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c7df3af0-eab0-4707-aa2f-17ca9b169318 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:30.383049 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c7df3af0-eab0-4707-aa2f-17ca9b169318 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.535454 Apr 12 16:19:30.383674 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 80/153] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:29 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:30.513994 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-567be708-2208-47ba-ba5c-2b928211926f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:30.527519 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-567be708-2208-47ba-ba5c-2b928211926f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.442150 Apr 12 16:19:30.529370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 74/154] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:30 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:30.949840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:30.950671 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:30.983405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:30.983874 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:30.984668 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:30.993457 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:31.413509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f853fc3a-52cf-4a5a-8882-3b877b856b1b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:31.413509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f853fc3a-52cf-4a5a-8882-3b877b856b1b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:31.413509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f853fc3a-52cf-4a5a-8882-3b877b856b1b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:31.415341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f853fc3a-52cf-4a5a-8882-3b877b856b1b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:31.417093 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f853fc3a-52cf-4a5a-8882-3b877b856b1b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:31.417787 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f853fc3a-52cf-4a5a-8882-3b877b856b1b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:31.466363 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:31.480232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:31.481724 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:31.483673 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1998bed7-62c1-4e5a-a984-efb6cebdbe4d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.562046 Apr 12 16:19:31.484240 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 81/155] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:30 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:31.495845 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-6e5cc8e6-4155-40d7-a989-93c3b2414425 req-a20b5f6d-fcc4-4900-a627-d870ae9dc80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac", "tag": "150e9cf9-34e1-43bb-8678-6b019f683dc6"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:31.517702 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-6e5cc8e6-4155-40d7-a989-93c3b2414425 req-a20b5f6d-fcc4-4900-a627-d870ae9dc80d service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:31.522289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-6e5cc8e6-4155-40d7-a989-93c3b2414425 req-a20b5f6d-fcc4-4900-a627-d870ae9dc80d service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:31.559586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-6e5cc8e6-4155-40d7-a989-93c3b2414425 req-a20b5f6d-fcc4-4900-a627-d870ae9dc80d service nova] Creating event network-changed:150e9cf9-34e1-43bb-8678-6b019f683dc6 for instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac on hv-cinder-83752 Apr 12 16:19:31.573232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-6e5cc8e6-4155-40d7-a989-93c3b2414425 req-a20b5f6d-fcc4-4900-a627-d870ae9dc80d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083262 Apr 12 16:19:31.576811 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 82/156] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:31.589081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2a35c205-5940-4fab-9c52-945705a81a68 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:31.591532 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2a35c205-5940-4fab-9c52-945705a81a68 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:31.605567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2a35c205-5940-4fab-9c52-945705a81a68 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:31.606793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2a35c205-5940-4fab-9c52-945705a81a68 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:31.607831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2a35c205-5940-4fab-9c52-945705a81a68 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:31.609677 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2a35c205-5940-4fab-9c52-945705a81a68 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:31.741075 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f853fc3a-52cf-4a5a-8882-3b877b856b1b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:31.751723 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f853fc3a-52cf-4a5a-8882-3b877b856b1b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1320 microversion: 2.1 time: 0.354824 Apr 12 16:19:31.752361 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 75/157] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:31 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:31.956502 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2a35c205-5940-4fab-9c52-945705a81a68 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:31.967303 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2a35c205-5940-4fab-9c52-945705a81a68 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.387540 Apr 12 16:19:31.967303 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 83/158] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:31 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:32.506841 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:32.508025 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:32.521701 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:32.522611 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:32.523622 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:32.524094 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:32.555184 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-93d5dea9-7105-4c13-93da-b23e7181ba01 req-ee89f317-d26f-46ff-886c-8522dfd78840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f48c36-5e37-4640-b589-df261265d809", "name": "network-vif-plugged", "status": "completed", "tag": "aaca632c-41bc-43f8-8889-7aea0e458ffa"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:32.571556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-93d5dea9-7105-4c13-93da-b23e7181ba01 req-ee89f317-d26f-46ff-886c-8522dfd78840 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:32.578867 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-93d5dea9-7105-4c13-93da-b23e7181ba01 req-ee89f317-d26f-46ff-886c-8522dfd78840 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:32.605420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-93d5dea9-7105-4c13-93da-b23e7181ba01 req-ee89f317-d26f-46ff-886c-8522dfd78840 service nova] Creating event network-vif-plugged:aaca632c-41bc-43f8-8889-7aea0e458ffa for instance 29f48c36-5e37-4640-b589-df261265d809 on hv-cinder-83752 Apr 12 16:19:32.627872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-93d5dea9-7105-4c13-93da-b23e7181ba01 req-ee89f317-d26f-46ff-886c-8522dfd78840 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076753 Apr 12 16:19:32.628787 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 84/159] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:32.769075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c4ca8bec-42a7-4f83-bf44-a20d32ebefd7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:32.769771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c4ca8bec-42a7-4f83-bf44-a20d32ebefd7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:32.783086 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4ca8bec-42a7-4f83-bf44-a20d32ebefd7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:32.783541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4ca8bec-42a7-4f83-bf44-a20d32ebefd7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:32.785016 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4ca8bec-42a7-4f83-bf44-a20d32ebefd7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:32.785459 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4ca8bec-42a7-4f83-bf44-a20d32ebefd7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:32.873064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:32.884025 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:32.885521 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:32.891166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d51fb45d-e34c-47de-a19f-deeb0e49d516 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.388459 Apr 12 16:19:32.893156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 76/160] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:32 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:19:32.984113 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5f7e76b0-cec7-4912-8c3d-07e32bd3f382 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:32.984733 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5f7e76b0-cec7-4912-8c3d-07e32bd3f382 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:33.004350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5f7e76b0-cec7-4912-8c3d-07e32bd3f382 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:33.005019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5f7e76b0-cec7-4912-8c3d-07e32bd3f382 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:33.005911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5f7e76b0-cec7-4912-8c3d-07e32bd3f382 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:33.011572 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5f7e76b0-cec7-4912-8c3d-07e32bd3f382 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:33.143308 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c4ca8bec-42a7-4f83-bf44-a20d32ebefd7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:33.162481 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c4ca8bec-42a7-4f83-bf44-a20d32ebefd7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1512 microversion: 2.1 time: 0.389308 Apr 12 16:19:33.163430 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 85/161] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:32 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:33.184409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-55f23d2f-422b-48b4-b26a-aab334cf4da2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:33.186196 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-55f23d2f-422b-48b4-b26a-aab334cf4da2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:33.197296 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-55f23d2f-422b-48b4-b26a-aab334cf4da2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:33.198101 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-55f23d2f-422b-48b4-b26a-aab334cf4da2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:33.199307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-55f23d2f-422b-48b4-b26a-aab334cf4da2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:33.200091 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-55f23d2f-422b-48b4-b26a-aab334cf4da2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:33.356598 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-55f23d2f-422b-48b4-b26a-aab334cf4da2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lazy-loading 'flavor' on Instance uuid 5d84741a-a53e-484d-b7c1-77df2336fa27 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:19:33.539808 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5f7e76b0-cec7-4912-8c3d-07e32bd3f382 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:33.552208 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5f7e76b0-cec7-4912-8c3d-07e32bd3f382 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.572660 Apr 12 16:19:33.554245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 77/162] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:32 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:33.643919 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-55f23d2f-422b-48b4-b26a-aab334cf4da2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27/action" status: 200 len: 32 microversion: 2.1 time: 0.463647 Apr 12 16:19:33.647480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 86/163] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:19:33 2022] POST /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:19:33.656632 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5b589b8a-f70e-4121-b691-c81881a6c920 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:33.657231 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5b589b8a-f70e-4121-b691-c81881a6c920 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:33.669233 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5b589b8a-f70e-4121-b691-c81881a6c920 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:33.669627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5b589b8a-f70e-4121-b691-c81881a6c920 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:33.670429 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5b589b8a-f70e-4121-b691-c81881a6c920 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:33.671132 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5b589b8a-f70e-4121-b691-c81881a6c920 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:33.914019 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:33.915021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:33.924517 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:33.930315 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:33.931441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:33.932350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:33.943429 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5b589b8a-f70e-4121-b691-c81881a6c920 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:33.950861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5b589b8a-f70e-4121-b691-c81881a6c920 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.297860 Apr 12 16:19:33.958368 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 78/164] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:33 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:34.250744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:34.260092 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:34.262462 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:34.264066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3376e5d6-ac74-44cb-a93d-de3c506f5d3a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.355038 Apr 12 16:19:34.264866 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 87/165] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:33 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:19:34.570909 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a040231b-a6e7-4e41-9a35-97376a7228dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:34.572235 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a040231b-a6e7-4e41-9a35-97376a7228dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:34.584390 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a040231b-a6e7-4e41-9a35-97376a7228dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:34.585399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a040231b-a6e7-4e41-9a35-97376a7228dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:34.586686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a040231b-a6e7-4e41-9a35-97376a7228dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:34.587963 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a040231b-a6e7-4e41-9a35-97376a7228dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:34.845356 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a040231b-a6e7-4e41-9a35-97376a7228dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:34.857112 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a040231b-a6e7-4e41-9a35-97376a7228dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.289839 Apr 12 16:19:34.858588 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 79/166] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:34 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:34.968862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-62de0b61-2a1f-4b94-94f6-c4fc4fd721c5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:34.969462 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-62de0b61-2a1f-4b94-94f6-c4fc4fd721c5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:34.980631 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-62de0b61-2a1f-4b94-94f6-c4fc4fd721c5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:34.981079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-62de0b61-2a1f-4b94-94f6-c4fc4fd721c5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:34.982121 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-62de0b61-2a1f-4b94-94f6-c4fc4fd721c5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:34.985560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-62de0b61-2a1f-4b94-94f6-c4fc4fd721c5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:35.231977 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-62de0b61-2a1f-4b94-94f6-c4fc4fd721c5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:35.239513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-62de0b61-2a1f-4b94-94f6-c4fc4fd721c5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.274653 Apr 12 16:19:35.240107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 88/167] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:34 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:35.282430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:35.282748 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:35.293878 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:35.294357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:35.295134 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:35.295564 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:35.571204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:35.588194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:35.590191 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:35.591738 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bf8f585a-4ac0-457b-929d-39f7c3a09177 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.313437 Apr 12 16:19:35.597342 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 80/168] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:35 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:35.875094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d0385069-5aeb-49b1-8215-dadb8cfaba60 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:35.875768 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d0385069-5aeb-49b1-8215-dadb8cfaba60 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:35.888095 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-e9bc8200-16a0-4530-a8db-8f79586d4f8b req-362dfdfe-5996-4a44-bbc5-57ead7a981b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23749e20-689d-41b3-b798-49c86d90ae20", "name": "network-vif-plugged", "status": "completed", "tag": "28e64fcd-7b2c-41c0-8cce-a7de7807a101"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:35.896280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d0385069-5aeb-49b1-8215-dadb8cfaba60 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:35.896916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d0385069-5aeb-49b1-8215-dadb8cfaba60 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:35.897712 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d0385069-5aeb-49b1-8215-dadb8cfaba60 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:35.898168 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d0385069-5aeb-49b1-8215-dadb8cfaba60 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:35.912514 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-e9bc8200-16a0-4530-a8db-8f79586d4f8b req-362dfdfe-5996-4a44-bbc5-57ead7a981b7 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:35.913049 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-e9bc8200-16a0-4530-a8db-8f79586d4f8b req-362dfdfe-5996-4a44-bbc5-57ead7a981b7 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:35.967999 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-e9bc8200-16a0-4530-a8db-8f79586d4f8b req-362dfdfe-5996-4a44-bbc5-57ead7a981b7 service nova] Creating event network-vif-plugged:28e64fcd-7b2c-41c0-8cce-a7de7807a101 for instance 23749e20-689d-41b3-b798-49c86d90ae20 on hv-cinder-83752 Apr 12 16:19:35.985934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-e9bc8200-16a0-4530-a8db-8f79586d4f8b req-362dfdfe-5996-4a44-bbc5-57ead7a981b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102210 Apr 12 16:19:35.988810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 81/169] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:36.236899 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d0385069-5aeb-49b1-8215-dadb8cfaba60 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:36.247050 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d0385069-5aeb-49b1-8215-dadb8cfaba60 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.375977 Apr 12 16:19:36.248285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 89/170] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:35 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:36.257709 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-aeed876d-e581-4502-a19c-6f4c94ddd436 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:36.258808 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-aeed876d-e581-4502-a19c-6f4c94ddd436 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:36.272123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aeed876d-e581-4502-a19c-6f4c94ddd436 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:36.275516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aeed876d-e581-4502-a19c-6f4c94ddd436 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:36.276987 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aeed876d-e581-4502-a19c-6f4c94ddd436 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:36.278580 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aeed876d-e581-4502-a19c-6f4c94ddd436 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:36.608973 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:36.610061 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:36.617670 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:36.618489 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:36.619629 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:36.620268 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:36.624838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-aeed876d-e581-4502-a19c-6f4c94ddd436 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:36.634627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-aeed876d-e581-4502-a19c-6f4c94ddd436 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.381269 Apr 12 16:19:36.635514 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 82/171] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:36 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:37.264845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-67da3847-38bb-490a-93b5-c3cd7997ec19 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:37.265581 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-67da3847-38bb-490a-93b5-c3cd7997ec19 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:37.275964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-67da3847-38bb-490a-93b5-c3cd7997ec19 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:37.276491 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-67da3847-38bb-490a-93b5-c3cd7997ec19 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:37.277769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-67da3847-38bb-490a-93b5-c3cd7997ec19 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:37.278284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-67da3847-38bb-490a-93b5-c3cd7997ec19 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:37.435751 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:37.444437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:37.447307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:37.448637 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3e90b469-36e5-43bb-b45d-bc924e268e7c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.843809 Apr 12 16:19:37.449210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 90/172] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:36 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:19:37.540233 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-67da3847-38bb-490a-93b5-c3cd7997ec19 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:37.549115 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-67da3847-38bb-490a-93b5-c3cd7997ec19 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.287975 Apr 12 16:19:37.549619 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 83/173] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:37 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:37.653955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2759062f-18e9-4597-aaf9-1f4c5b3c693e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:37.653955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2759062f-18e9-4597-aaf9-1f4c5b3c693e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:37.682726 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2759062f-18e9-4597-aaf9-1f4c5b3c693e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:37.683435 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2759062f-18e9-4597-aaf9-1f4c5b3c693e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:37.684391 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2759062f-18e9-4597-aaf9-1f4c5b3c693e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:37.684971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2759062f-18e9-4597-aaf9-1f4c5b3c693e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:37.742354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7e1c53e1-3795-4801-8e63-324e164f380e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:37.743468 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7e1c53e1-3795-4801-8e63-324e164f380e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:37.750226 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7e1c53e1-3795-4801-8e63-324e164f380e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:37.750932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7e1c53e1-3795-4801-8e63-324e164f380e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:37.751719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7e1c53e1-3795-4801-8e63-324e164f380e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:37.752218 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7e1c53e1-3795-4801-8e63-324e164f380e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:37.781310 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7e1c53e1-3795-4801-8e63-324e164f380e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:19:37.881640 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7e1c53e1-3795-4801-8e63-324e164f380e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "DELETE /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 204 len: 0 microversion: 2.1 time: 0.143087 Apr 12 16:19:37.885815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 84/174] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:19:37 2022] DELETE /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:19:37.891498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-555538d9-b99f-49f8-9277-63fe3ca424bd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:37.892653 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-555538d9-b99f-49f8-9277-63fe3ca424bd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:37.899105 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-555538d9-b99f-49f8-9277-63fe3ca424bd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:37.899573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-555538d9-b99f-49f8-9277-63fe3ca424bd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:37.900439 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-555538d9-b99f-49f8-9277-63fe3ca424bd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:37.900815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-555538d9-b99f-49f8-9277-63fe3ca424bd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:38.128644 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2759062f-18e9-4597-aaf9-1f4c5b3c693e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:38.141465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2759062f-18e9-4597-aaf9-1f4c5b3c693e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.492775 Apr 12 16:19:38.148449 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 91/175] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:37 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:38.231146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-555538d9-b99f-49f8-9277-63fe3ca424bd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:38.243600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-555538d9-b99f-49f8-9277-63fe3ca424bd tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1553 microversion: 2.1 time: 0.356033 Apr 12 16:19:38.257772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 85/176] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:37 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1553 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:38.467545 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:38.468660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:38.474860 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:38.475528 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:38.476490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:38.476928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:38.568214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-14e6bfe6-e6f5-4df5-9143-54a1d8f0c502 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:38.569287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-14e6bfe6-e6f5-4df5-9143-54a1d8f0c502 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:38.580791 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-14e6bfe6-e6f5-4df5-9143-54a1d8f0c502 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:38.581434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-14e6bfe6-e6f5-4df5-9143-54a1d8f0c502 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:38.582293 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-14e6bfe6-e6f5-4df5-9143-54a1d8f0c502 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:38.582729 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-14e6bfe6-e6f5-4df5-9143-54a1d8f0c502 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:38.797455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:38.830881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:38.835252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:38.837129 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1bd71fbd-dd2c-4b23-8009-7dbb5e283790 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.373595 Apr 12 16:19:38.841757 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-14e6bfe6-e6f5-4df5-9143-54a1d8f0c502 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:38.848952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 92/177] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:38 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:38.853892 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-14e6bfe6-e6f5-4df5-9143-54a1d8f0c502 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.292393 Apr 12 16:19:38.854507 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 86/178] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:38 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:39.159530 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-296bf2b1-eb25-4f98-bce5-f25b7296f90e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:39.160232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-296bf2b1-eb25-4f98-bce5-f25b7296f90e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:39.168022 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-296bf2b1-eb25-4f98-bce5-f25b7296f90e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:39.168556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-296bf2b1-eb25-4f98-bce5-f25b7296f90e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:39.169406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-296bf2b1-eb25-4f98-bce5-f25b7296f90e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:39.169921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-296bf2b1-eb25-4f98-bce5-f25b7296f90e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:39.267195 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4d716332-9af8-4610-83b4-c437e0c6636e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:39.268023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4d716332-9af8-4610-83b4-c437e0c6636e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:39.277613 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4d716332-9af8-4610-83b4-c437e0c6636e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:39.279055 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4d716332-9af8-4610-83b4-c437e0c6636e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:39.280798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4d716332-9af8-4610-83b4-c437e0c6636e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:39.281848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4d716332-9af8-4610-83b4-c437e0c6636e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:39.400416 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-296bf2b1-eb25-4f98-bce5-f25b7296f90e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:39.412681 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-296bf2b1-eb25-4f98-bce5-f25b7296f90e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.257364 Apr 12 16:19:39.422829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 93/179] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:39 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:39.468454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4d716332-9af8-4610-83b4-c437e0c6636e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:39.481347 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4d716332-9af8-4610-83b4-c437e0c6636e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1553 microversion: 2.1 time: 0.220362 Apr 12 16:19:39.481987 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 87/180] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:39 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:39.855606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:39.856138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:39.862301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:39.863039 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:39.864019 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:39.864921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:39.870374 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-07923fae-7a8a-447e-bcbf-7dcd6038d6fe tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:39.871774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-07923fae-7a8a-447e-bcbf-7dcd6038d6fe tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:39.882360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07923fae-7a8a-447e-bcbf-7dcd6038d6fe tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:39.883670 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07923fae-7a8a-447e-bcbf-7dcd6038d6fe tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:39.885087 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07923fae-7a8a-447e-bcbf-7dcd6038d6fe tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:39.886547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07923fae-7a8a-447e-bcbf-7dcd6038d6fe tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:40.235588 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:40.237577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-07923fae-7a8a-447e-bcbf-7dcd6038d6fe tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:40.248006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-07923fae-7a8a-447e-bcbf-7dcd6038d6fe tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.380082 Apr 12 16:19:40.248616 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 88/181] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:39 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:40.250977 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:40.270944 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:40.274859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c589a080-e5fa-4334-9828-92d4b501cdfc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1406 microversion: 2.20 time: 0.422974 Apr 12 16:19:40.276953 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 94/182] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:39 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:40.429537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9d5adb29-1e71-4f56-b945-b10c1b212c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:40.431633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9d5adb29-1e71-4f56-b945-b10c1b212c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:40.442752 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d5adb29-1e71-4f56-b945-b10c1b212c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:40.443209 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d5adb29-1e71-4f56-b945-b10c1b212c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:40.450795 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d5adb29-1e71-4f56-b945-b10c1b212c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:40.451366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d5adb29-1e71-4f56-b945-b10c1b212c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:40.499324 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a44b96fe-70b2-4fc0-83a6-1abc568d1448 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:40.502579 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a44b96fe-70b2-4fc0-83a6-1abc568d1448 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:40.520358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a44b96fe-70b2-4fc0-83a6-1abc568d1448 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:40.522394 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a44b96fe-70b2-4fc0-83a6-1abc568d1448 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:40.523212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a44b96fe-70b2-4fc0-83a6-1abc568d1448 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:40.523647 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a44b96fe-70b2-4fc0-83a6-1abc568d1448 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:41.070511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9d5adb29-1e71-4f56-b945-b10c1b212c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:41.079841 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9d5adb29-1e71-4f56-b945-b10c1b212c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.654846 Apr 12 16:19:41.081147 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 89/183] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:40 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:41.222966 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a44b96fe-70b2-4fc0-83a6-1abc568d1448 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:41.242943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a44b96fe-70b2-4fc0-83a6-1abc568d1448 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1553 microversion: 2.1 time: 0.747685 Apr 12 16:19:41.243856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 95/184] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:40 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1553 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:41.291419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5d4d630b-307c-4953-aaee-26cd907e7839 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:41.292083 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5d4d630b-307c-4953-aaee-26cd907e7839 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:41.306247 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5d4d630b-307c-4953-aaee-26cd907e7839 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:41.308110 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:41.308823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:41.310756 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5d4d630b-307c-4953-aaee-26cd907e7839 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:41.311647 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5d4d630b-307c-4953-aaee-26cd907e7839 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:41.312081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5d4d630b-307c-4953-aaee-26cd907e7839 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:41.331311 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:41.331760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:41.332543 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:41.333273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:41.632193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5d4d630b-307c-4953-aaee-26cd907e7839 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:41.644920 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5d4d630b-307c-4953-aaee-26cd907e7839 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.383470 Apr 12 16:19:41.645837 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 90/185] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:41 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:41.701912 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:41.710713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:41.712368 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:41.713876 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-20e8a947-f464-4beb-98eb-16bb0573211a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1599 microversion: 2.20 time: 0.418692 Apr 12 16:19:41.714626 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 96/186] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:19:41 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1599 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:19:41.733048 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1d5e32e6-d0b7-4d68-b78f-b3457cb5e103 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:41.733802 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1d5e32e6-d0b7-4d68-b78f-b3457cb5e103 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:41.740364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1d5e32e6-d0b7-4d68-b78f-b3457cb5e103 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:41.740808 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1d5e32e6-d0b7-4d68-b78f-b3457cb5e103 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:41.741598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1d5e32e6-d0b7-4d68-b78f-b3457cb5e103 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:41.742077 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1d5e32e6-d0b7-4d68-b78f-b3457cb5e103 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:41.829481 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1d5e32e6-d0b7-4d68-b78f-b3457cb5e103 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100294 Apr 12 16:19:41.830187 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 91/187] 10.222.0.67 () {60 vars in 1315 bytes} [Tue Apr 12 16:19:41 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:19:42.103049 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-879ee29b-7e08-4e63-b11f-fbc7126bd5b9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:42.103781 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-879ee29b-7e08-4e63-b11f-fbc7126bd5b9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:42.111509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-879ee29b-7e08-4e63-b11f-fbc7126bd5b9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:42.111964 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-879ee29b-7e08-4e63-b11f-fbc7126bd5b9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:42.112755 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-879ee29b-7e08-4e63-b11f-fbc7126bd5b9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:42.114856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-879ee29b-7e08-4e63-b11f-fbc7126bd5b9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:42.260297 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3cca0211-b66c-444b-b16c-afdb3ef4d285 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:42.261535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3cca0211-b66c-444b-b16c-afdb3ef4d285 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:42.277970 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cca0211-b66c-444b-b16c-afdb3ef4d285 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:42.278444 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cca0211-b66c-444b-b16c-afdb3ef4d285 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:42.288142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cca0211-b66c-444b-b16c-afdb3ef4d285 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:42.288905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cca0211-b66c-444b-b16c-afdb3ef4d285 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:42.294902 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-879ee29b-7e08-4e63-b11f-fbc7126bd5b9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:42.309688 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-879ee29b-7e08-4e63-b11f-fbc7126bd5b9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.214432 Apr 12 16:19:42.311751 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 97/188] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:42 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:42.487910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3cca0211-b66c-444b-b16c-afdb3ef4d285 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:42.499070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3cca0211-b66c-444b-b16c-afdb3ef4d285 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1553 microversion: 2.1 time: 0.243193 Apr 12 16:19:42.508848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 92/189] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:42 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1553 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:42.677445 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7ccec9cb-4e3b-4aeb-9747-2bf312939122 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:42.678090 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7ccec9cb-4e3b-4aeb-9747-2bf312939122 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:42.686109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ccec9cb-4e3b-4aeb-9747-2bf312939122 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:42.686571 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ccec9cb-4e3b-4aeb-9747-2bf312939122 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:42.699520 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ccec9cb-4e3b-4aeb-9747-2bf312939122 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:42.699983 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ccec9cb-4e3b-4aeb-9747-2bf312939122 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:43.169541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-7ccec9cb-4e3b-4aeb-9747-2bf312939122 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:43.177402 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7ccec9cb-4e3b-4aeb-9747-2bf312939122 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1362 microversion: 2.1 time: 0.519020 Apr 12 16:19:43.193299 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 98/190] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:42 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:43.331454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-180a2441-5002-4601-8629-b00115b9795f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:43.333048 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-180a2441-5002-4601-8629-b00115b9795f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:43.346398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-180a2441-5002-4601-8629-b00115b9795f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:43.347154 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-180a2441-5002-4601-8629-b00115b9795f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:43.351099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-180a2441-5002-4601-8629-b00115b9795f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:43.351810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-180a2441-5002-4601-8629-b00115b9795f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:43.526957 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-760fe93f-7c48-4cc0-9725-b1e32c7b75b7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:43.528646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-760fe93f-7c48-4cc0-9725-b1e32c7b75b7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:43.551723 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-760fe93f-7c48-4cc0-9725-b1e32c7b75b7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:43.553473 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-760fe93f-7c48-4cc0-9725-b1e32c7b75b7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:43.557603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-760fe93f-7c48-4cc0-9725-b1e32c7b75b7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:43.558330 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-760fe93f-7c48-4cc0-9725-b1e32c7b75b7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:43.781087 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-760fe93f-7c48-4cc0-9725-b1e32c7b75b7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:43.800557 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-760fe93f-7c48-4cc0-9725-b1e32c7b75b7 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1511 microversion: 2.1 time: 0.274798 Apr 12 16:19:43.801233 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 99/191] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:43 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:43.840609 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-7f4ac85d-081c-4d26-bacd-557921d67c56 req-dfa602c7-531c-4788-8167-ec8e0decdc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487aea79-f1c3-4ab8-9d49-cee300992479", "name": "network-vif-deleted", "tag": "f139bb8c-aace-4035-a88f-6180d6399d1b"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:43.866775 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-180a2441-5002-4601-8629-b00115b9795f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:43.871007 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-7f4ac85d-081c-4d26-bacd-557921d67c56 req-dfa602c7-531c-4788-8167-ec8e0decdc8a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:43.871641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-7f4ac85d-081c-4d26-bacd-557921d67c56 req-dfa602c7-531c-4788-8167-ec8e0decdc8a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:43.876763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-180a2441-5002-4601-8629-b00115b9795f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.550406 Apr 12 16:19:43.896764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 93/192] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:43 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:43.943422 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-7f4ac85d-081c-4d26-bacd-557921d67c56 req-dfa602c7-531c-4788-8167-ec8e0decdc8a service nova] Creating event network-vif-deleted:f139bb8c-aace-4035-a88f-6180d6399d1b for instance 487aea79-f1c3-4ab8-9d49-cee300992479 on hv-cinder-83752 Apr 12 16:19:43.960109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-7f4ac85d-081c-4d26-bacd-557921d67c56 req-dfa602c7-531c-4788-8167-ec8e0decdc8a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153467 Apr 12 16:19:43.962456 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 100/193] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:44.063686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-4b7b5c08-cbb6-4583-9d71-f27bebac05c5 req-bf338c90-3998-4d25-9edc-64da0e96503f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f48c36-5e37-4640-b589-df261265d809", "tag": "aaca632c-41bc-43f8-8889-7aea0e458ffa"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:44.074980 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-4b7b5c08-cbb6-4583-9d71-f27bebac05c5 req-bf338c90-3998-4d25-9edc-64da0e96503f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.075623 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-4b7b5c08-cbb6-4583-9d71-f27bebac05c5 req-bf338c90-3998-4d25-9edc-64da0e96503f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.089275 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-4b7b5c08-cbb6-4583-9d71-f27bebac05c5 req-bf338c90-3998-4d25-9edc-64da0e96503f service nova] Creating event network-changed:aaca632c-41bc-43f8-8889-7aea0e458ffa for instance 29f48c36-5e37-4640-b589-df261265d809 on hv-cinder-83752 Apr 12 16:19:44.095804 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-4b7b5c08-cbb6-4583-9d71-f27bebac05c5 req-bf338c90-3998-4d25-9edc-64da0e96503f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039509 Apr 12 16:19:44.096865 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 94/194] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:44.206885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6d723423-40ec-42ba-bd19-b67e5e5f8fd2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:44.209021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6d723423-40ec-42ba-bd19-b67e5e5f8fd2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:44.245244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d723423-40ec-42ba-bd19-b67e5e5f8fd2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.246214 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d723423-40ec-42ba-bd19-b67e5e5f8fd2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.247925 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d723423-40ec-42ba-bd19-b67e5e5f8fd2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.248601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d723423-40ec-42ba-bd19-b67e5e5f8fd2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.540394 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6d723423-40ec-42ba-bd19-b67e5e5f8fd2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:44.555437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6d723423-40ec-42ba-bd19-b67e5e5f8fd2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1548 microversion: 2.1 time: 0.358066 Apr 12 16:19:44.556971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 101/195] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:44 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1548 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:44.575238 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-51c7dcc8-2a66-43be-ab27-30128cae6e61 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:44.575870 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-51c7dcc8-2a66-43be-ab27-30128cae6e61 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:44.583815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-51c7dcc8-2a66-43be-ab27-30128cae6e61 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.584836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-51c7dcc8-2a66-43be-ab27-30128cae6e61 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.585788 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-51c7dcc8-2a66-43be-ab27-30128cae6e61 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.586406 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-51c7dcc8-2a66-43be-ab27-30128cae6e61 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.706805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-51c7dcc8-2a66-43be-ab27-30128cae6e61 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136494 Apr 12 16:19:44.711094 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 95/196] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Apr 12 16:19:44 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:44.818565 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b424f8a5-a9b6-4745-b953-2aa23f039318 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:44.819149 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b424f8a5-a9b6-4745-b953-2aa23f039318 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:44.827453 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b424f8a5-a9b6-4745-b953-2aa23f039318 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.827900 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b424f8a5-a9b6-4745-b953-2aa23f039318 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.833456 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b424f8a5-a9b6-4745-b953-2aa23f039318 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.838324 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b424f8a5-a9b6-4745-b953-2aa23f039318 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.904622 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1504b2e3-6922-4def-8aa5-007dcd0bddb1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:44.905263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1504b2e3-6922-4def-8aa5-007dcd0bddb1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:44.914129 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1504b2e3-6922-4def-8aa5-007dcd0bddb1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.914583 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1504b2e3-6922-4def-8aa5-007dcd0bddb1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.915364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1504b2e3-6922-4def-8aa5-007dcd0bddb1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:44.921622 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1504b2e3-6922-4def-8aa5-007dcd0bddb1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:44.972614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b424f8a5-a9b6-4745-b953-2aa23f039318 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:44.985280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b424f8a5-a9b6-4745-b953-2aa23f039318 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1346 microversion: 2.1 time: 0.168281 Apr 12 16:19:44.997747 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 102/197] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:44 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:45.236730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1504b2e3-6922-4def-8aa5-007dcd0bddb1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:45.245830 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1504b2e3-6922-4def-8aa5-007dcd0bddb1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.344981 Apr 12 16:19:45.249989 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 96/198] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:44 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:46.017654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3f86f1ff-8ff3-471c-8c9e-a5e553e31bec tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:46.019950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3f86f1ff-8ff3-471c-8c9e-a5e553e31bec tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:46.030462 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3f86f1ff-8ff3-471c-8c9e-a5e553e31bec tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:46.031114 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3f86f1ff-8ff3-471c-8c9e-a5e553e31bec tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:46.032274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3f86f1ff-8ff3-471c-8c9e-a5e553e31bec tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:46.032859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3f86f1ff-8ff3-471c-8c9e-a5e553e31bec tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:46.150099 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3f86f1ff-8ff3-471c-8c9e-a5e553e31bec tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:46.166980 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3f86f1ff-8ff3-471c-8c9e-a5e553e31bec tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1346 microversion: 2.1 time: 0.166000 Apr 12 16:19:46.167609 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 103/199] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:45 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1346 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:46.268450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0e1ab697-f690-4930-8a26-d2a0751ccadb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:46.269085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0e1ab697-f690-4930-8a26-d2a0751ccadb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:46.279361 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0e1ab697-f690-4930-8a26-d2a0751ccadb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:46.282593 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0e1ab697-f690-4930-8a26-d2a0751ccadb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:46.283457 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0e1ab697-f690-4930-8a26-d2a0751ccadb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:46.283896 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0e1ab697-f690-4930-8a26-d2a0751ccadb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:46.473931 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0e1ab697-f690-4930-8a26-d2a0751ccadb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:46.481909 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0e1ab697-f690-4930-8a26-d2a0751ccadb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.218221 Apr 12 16:19:46.493530 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 97/200] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:46 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:46.550684 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-c933ca10-1a6e-4f95-9cfc-8101075a9342 req-d691412e-c80e-4dd9-81b4-e105c4cd0945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23749e20-689d-41b3-b798-49c86d90ae20", "tag": "28e64fcd-7b2c-41c0-8cce-a7de7807a101"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:46.563242 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-c933ca10-1a6e-4f95-9cfc-8101075a9342 req-d691412e-c80e-4dd9-81b4-e105c4cd0945 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:46.564025 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-c933ca10-1a6e-4f95-9cfc-8101075a9342 req-d691412e-c80e-4dd9-81b4-e105c4cd0945 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:46.583157 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-c933ca10-1a6e-4f95-9cfc-8101075a9342 req-d691412e-c80e-4dd9-81b4-e105c4cd0945 service nova] Creating event network-changed:28e64fcd-7b2c-41c0-8cce-a7de7807a101 for instance 23749e20-689d-41b3-b798-49c86d90ae20 on hv-cinder-83752 Apr 12 16:19:46.589190 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-c933ca10-1a6e-4f95-9cfc-8101075a9342 req-d691412e-c80e-4dd9-81b4-e105c4cd0945 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042319 Apr 12 16:19:46.593100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 104/201] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:47.184659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a4e0f7d5-0838-4eeb-83fd-e6c9a12e278f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:47.185453 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a4e0f7d5-0838-4eeb-83fd-e6c9a12e278f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:47.194851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4e0f7d5-0838-4eeb-83fd-e6c9a12e278f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:47.195302 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4e0f7d5-0838-4eeb-83fd-e6c9a12e278f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:47.196409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4e0f7d5-0838-4eeb-83fd-e6c9a12e278f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:47.196853 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4e0f7d5-0838-4eeb-83fd-e6c9a12e278f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:47.265346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a4e0f7d5-0838-4eeb-83fd-e6c9a12e278f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:47.274263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a4e0f7d5-0838-4eeb-83fd-e6c9a12e278f tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1346 microversion: 2.1 time: 0.094311 Apr 12 16:19:47.275346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 98/202] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:47 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:47.501227 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6973ab7d-acf6-4f2c-9a91-6d40b5043fef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:47.501848 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6973ab7d-acf6-4f2c-9a91-6d40b5043fef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:47.509346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6973ab7d-acf6-4f2c-9a91-6d40b5043fef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:47.510225 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6973ab7d-acf6-4f2c-9a91-6d40b5043fef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:47.511379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6973ab7d-acf6-4f2c-9a91-6d40b5043fef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:47.512030 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6973ab7d-acf6-4f2c-9a91-6d40b5043fef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:47.714245 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6973ab7d-acf6-4f2c-9a91-6d40b5043fef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:47.720413 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6973ab7d-acf6-4f2c-9a91-6d40b5043fef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.223766 Apr 12 16:19:47.730536 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 105/203] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:47 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:48.293356 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-04100ecb-072a-49da-a81a-0f0983ab8f0e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:48.293975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-04100ecb-072a-49da-a81a-0f0983ab8f0e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:48.312381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-04100ecb-072a-49da-a81a-0f0983ab8f0e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:48.313008 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-04100ecb-072a-49da-a81a-0f0983ab8f0e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:48.314661 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-04100ecb-072a-49da-a81a-0f0983ab8f0e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:48.315545 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-04100ecb-072a-49da-a81a-0f0983ab8f0e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:48.479005 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-04100ecb-072a-49da-a81a-0f0983ab8f0e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:48.491924 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-04100ecb-072a-49da-a81a-0f0983ab8f0e tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1346 microversion: 2.1 time: 0.204551 Apr 12 16:19:48.495092 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 99/204] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:48 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1346 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:48.740439 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-10fe939d-7927-432e-825f-a2b70a88bc5f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:48.741204 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-10fe939d-7927-432e-825f-a2b70a88bc5f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:48.747526 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-10fe939d-7927-432e-825f-a2b70a88bc5f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:48.748305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-10fe939d-7927-432e-825f-a2b70a88bc5f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:48.749312 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-10fe939d-7927-432e-825f-a2b70a88bc5f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:48.749959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-10fe939d-7927-432e-825f-a2b70a88bc5f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:48.996004 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-10fe939d-7927-432e-825f-a2b70a88bc5f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:49.006824 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-10fe939d-7927-432e-825f-a2b70a88bc5f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.272447 Apr 12 16:19:49.007409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 106/205] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:48 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:49.510418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:49.511001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:49.518606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:49.519264 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:49.520211 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:49.521082 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:49.553920 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:49.554731 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:49.555388 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lazy-loading 'fault' on Instance uuid 487aea79-f1c3-4ab8-9d49-cee300992479 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:19:49.615531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf6972f4064287ab19383277ee8b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b531609069a4de8b99bbdf8d139cb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:49.626794 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-850ad4ef-2e15-491b-b738-ec6f3988e638 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 200 len: 1351 microversion: 2.1 time: 0.120488 Apr 12 16:19:49.638222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 100/206] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:49 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:50.024434 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-da24472b-47c4-4720-88b6-45fc92b5a81e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:50.024972 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-da24472b-47c4-4720-88b6-45fc92b5a81e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:50.033018 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da24472b-47c4-4720-88b6-45fc92b5a81e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:50.033804 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da24472b-47c4-4720-88b6-45fc92b5a81e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:50.034793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da24472b-47c4-4720-88b6-45fc92b5a81e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:50.035224 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da24472b-47c4-4720-88b6-45fc92b5a81e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:50.195212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-da24472b-47c4-4720-88b6-45fc92b5a81e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:50.206460 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-da24472b-47c4-4720-88b6-45fc92b5a81e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.186207 Apr 12 16:19:50.207370 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 107/207] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:50 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:50.652685 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:50.654093 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:50.664363 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:50.664819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:50.665635 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:50.666237 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:50.684242 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] HTTP exception thrown: Instance 487aea79-f1c3-4ab8-9d49-cee300992479 could not be found. Apr 12 16:19:50.684849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Returning 404 to user: Instance 487aea79-f1c3-4ab8-9d49-cee300992479 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:19:50.685687 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-61aa23d0-4055-439d-bd95-51d6ae035a18 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 404 len: 111 microversion: 2.1 time: 0.037303 Apr 12 16:19:50.686297 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 101/208] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:50 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:19:50.812821 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:50.813870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:50.820654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:50.821191 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:50.822067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:50.822555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:50.838375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] HTTP exception thrown: Instance 487aea79-f1c3-4ab8-9d49-cee300992479 could not be found. Apr 12 16:19:50.838967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Returning 404 to user: Instance 487aea79-f1c3-4ab8-9d49-cee300992479 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:19:50.839810 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3a6ce293-7ae5-4574-adef-9cee8e8f5e5c tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031511 Apr 12 16:19:50.840372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 108/209] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:19:50 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:19:51.227546 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-94c4202f-8fa6-4a1b-a53c-567eff3b9afa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:51.228475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-94c4202f-8fa6-4a1b-a53c-567eff3b9afa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:51.235104 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-94c4202f-8fa6-4a1b-a53c-567eff3b9afa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:51.235811 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-94c4202f-8fa6-4a1b-a53c-567eff3b9afa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:51.238159 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-94c4202f-8fa6-4a1b-a53c-567eff3b9afa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:51.238846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-94c4202f-8fa6-4a1b-a53c-567eff3b9afa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:51.420957 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-94c4202f-8fa6-4a1b-a53c-567eff3b9afa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:51.429913 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-94c4202f-8fa6-4a1b-a53c-567eff3b9afa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.206570 Apr 12 16:19:51.430541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 102/210] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:51 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:52.447280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ff90cc94-e8e2-4b71-a8db-878f07ac675b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:52.447928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ff90cc94-e8e2-4b71-a8db-878f07ac675b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:52.454621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff90cc94-e8e2-4b71-a8db-878f07ac675b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:52.455059 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff90cc94-e8e2-4b71-a8db-878f07ac675b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:52.456009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff90cc94-e8e2-4b71-a8db-878f07ac675b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:52.456608 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff90cc94-e8e2-4b71-a8db-878f07ac675b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:52.596333 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ff90cc94-e8e2-4b71-a8db-878f07ac675b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:52.604417 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ff90cc94-e8e2-4b71-a8db-878f07ac675b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.161328 Apr 12 16:19:52.605262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 109/211] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:52 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:53.621873 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a3ab922f-3d02-4052-8a4a-6a2c09fb4875 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:53.624041 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a3ab922f-3d02-4052-8a4a-6a2c09fb4875 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:53.634189 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a3ab922f-3d02-4052-8a4a-6a2c09fb4875 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:53.634735 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a3ab922f-3d02-4052-8a4a-6a2c09fb4875 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:53.635989 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a3ab922f-3d02-4052-8a4a-6a2c09fb4875 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:53.636235 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a3ab922f-3d02-4052-8a4a-6a2c09fb4875 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:53.781513 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a3ab922f-3d02-4052-8a4a-6a2c09fb4875 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:53.791391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a3ab922f-3d02-4052-8a4a-6a2c09fb4875 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.173617 Apr 12 16:19:53.791983 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 103/212] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:53 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:54.269773 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5a2c086f-db3e-4f8b-9e01-28eb24549140 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Action: 'create', calling method: .version_select at 0x7f246de6aa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-268036333"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:54.283730 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5a2c086f-db3e-4f8b-9e01-28eb24549140 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Getting quotas for project f91e85c02b6e47d9913792e1168a8939. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:19:54.288499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5a2c086f-db3e-4f8b-9e01-28eb24549140 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Getting quotas for user e3630119bdbb4f70a060a355dd14f44f and project f91e85c02b6e47d9913792e1168a8939. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:19:54.382436 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5a2c086f-db3e-4f8b-9e01-28eb24549140 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Getting quotas for project f91e85c02b6e47d9913792e1168a8939. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:19:54.386326 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5a2c086f-db3e-4f8b-9e01-28eb24549140 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Getting quotas for user e3630119bdbb4f70a060a355dd14f44f and project f91e85c02b6e47d9913792e1168a8939. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:19:54.399596 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5a2c086f-db3e-4f8b-9e01-28eb24549140 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.133677 Apr 12 16:19:54.400188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 110/213] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:19:54 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:54.451176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1595718381", "imageRef": "97a35780-88da-40e3-afbb-cbc184a48abf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-268036333", "networks": [{"uuid": "d961f9a5-00d9-4fdf-8ce1-eaa2cc0156aa"}]}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:54.501012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] validate_networks() for [('d961f9a5-00d9-4fdf-8ce1-eaa2cc0156aa', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:19:54.809753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9d8cb17d-f775-40ef-a6e1-3e6feebbdba5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:54.810552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9d8cb17d-f775-40ef-a6e1-3e6feebbdba5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:54.816770 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d8cb17d-f775-40ef-a6e1-3e6feebbdba5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:54.817329 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d8cb17d-f775-40ef-a6e1-3e6feebbdba5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:54.818332 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d8cb17d-f775-40ef-a6e1-3e6feebbdba5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:54.818939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d8cb17d-f775-40ef-a6e1-3e6feebbdba5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:54.940079 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:19:54.940569 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:19:54.941080 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:19:54.941608 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:19:54.942028 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:19:54.951735 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:54.952214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:54.953216 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:54.953658 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:54.971744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Getting quotas for project f91e85c02b6e47d9913792e1168a8939. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:19:54.976239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9d8cb17d-f775-40ef-a6e1-3e6feebbdba5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:54.976413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Getting quotas for user e3630119bdbb4f70a060a355dd14f44f and project f91e85c02b6e47d9913792e1168a8939. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:19:54.989215 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9d8cb17d-f775-40ef-a6e1-3e6feebbdba5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.184458 Apr 12 16:19:54.989560 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:19:54.990260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 111/214] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:54 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:54.992213 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97a35780-88da-40e3-afbb-cbc184a48abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:19:55.049353 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4432e6ae-f0b6-4770-a9d3-01e888719bd5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602001 Apr 12 16:19:55.050003 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 104/215] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:19:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:19:55.060425 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bd4641f6-cffb-4c6d-a879-7f1db2c7b53e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:55.061265 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bd4641f6-cffb-4c6d-a879-7f1db2c7b53e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:55.114725 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-bd4641f6-cffb-4c6d-a879-7f1db2c7b53e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:55.121420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bd4641f6-cffb-4c6d-a879-7f1db2c7b53e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1258 microversion: 2.1 time: 0.064810 Apr 12 16:19:55.121963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 112/216] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:55 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:55.259469 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:55.259974 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:55.266517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:55.266971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:55.267874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:55.268431 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:55.283232 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] HTTP exception thrown: Instance 487aea79-f1c3-4ab8-9d49-cee300992479 could not be found. Apr 12 16:19:55.283824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Returning 404 to user: Instance 487aea79-f1c3-4ab8-9d49-cee300992479 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:19:55.284688 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-641a75ac-4740-421b-a7af-f0421e5b168d tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "DELETE /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 404 len: 111 microversion: 2.1 time: 0.030504 Apr 12 16:19:55.285828 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 105/217] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:19:55 2022] DELETE /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:19:55.293982 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:55.294610 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] [instance: 487aea79-f1c3-4ab8-9d49-cee300992479] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:55.302283 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:55.302728 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:55.303502 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:55.303911 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:55.318678 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] HTTP exception thrown: Instance 487aea79-f1c3-4ab8-9d49-cee300992479 could not be found. Apr 12 16:19:55.319051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] Returning 404 to user: Instance 487aea79-f1c3-4ab8-9d49-cee300992479 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:19:55.319891 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c4434bc6-ac4e-4428-92d0-947158c851b4 tempest-DeleteServersTestJSON-1332451371 tempest-DeleteServersTestJSON-1332451371-project] 10.222.0.67 "GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479" status: 404 len: 111 microversion: 2.1 time: 0.029760 Apr 12 16:19:55.320451 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 113/218] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:55 2022] GET /compute/v2.1/servers/487aea79-f1c3-4ab8-9d49-cee300992479 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:19:56.009350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eebc8277-b1a2-41fd-8115-2b6a0c5523c1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:56.010246 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-eebc8277-b1a2-41fd-8115-2b6a0c5523c1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:56.022993 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eebc8277-b1a2-41fd-8115-2b6a0c5523c1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:56.024058 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eebc8277-b1a2-41fd-8115-2b6a0c5523c1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:56.024973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eebc8277-b1a2-41fd-8115-2b6a0c5523c1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:56.025605 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eebc8277-b1a2-41fd-8115-2b6a0c5523c1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:56.139675 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-48c0d3f8-c550-4dba-903b-4cd9ee8bd162 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:56.140555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-48c0d3f8-c550-4dba-903b-4cd9ee8bd162 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:56.147650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-48c0d3f8-c550-4dba-903b-4cd9ee8bd162 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:56.148180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-48c0d3f8-c550-4dba-903b-4cd9ee8bd162 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:56.149243 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-48c0d3f8-c550-4dba-903b-4cd9ee8bd162 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:56.149815 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-48c0d3f8-c550-4dba-903b-4cd9ee8bd162 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:56.392288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-48c0d3f8-c550-4dba-903b-4cd9ee8bd162 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:56.405332 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-48c0d3f8-c550-4dba-903b-4cd9ee8bd162 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1310 microversion: 2.1 time: 0.269791 Apr 12 16:19:56.405920 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 114/219] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:56 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1310 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:56.447203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-eebc8277-b1a2-41fd-8115-2b6a0c5523c1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:56.456506 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-eebc8277-b1a2-41fd-8115-2b6a0c5523c1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.453410 Apr 12 16:19:56.457419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 106/220] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:56 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:19:57.423701 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b73d3c56-5cf2-4f86-92ad-cd87e5517981 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:57.425377 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b73d3c56-5cf2-4f86-92ad-cd87e5517981 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:57.434443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b73d3c56-5cf2-4f86-92ad-cd87e5517981 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:57.441076 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b73d3c56-5cf2-4f86-92ad-cd87e5517981 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:57.445071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b73d3c56-5cf2-4f86-92ad-cd87e5517981 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:57.446130 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b73d3c56-5cf2-4f86-92ad-cd87e5517981 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:57.476426 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a5609b99-7bf4-4fab-9333-601e961d411c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:57.478268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a5609b99-7bf4-4fab-9333-601e961d411c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:57.489006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5609b99-7bf4-4fab-9333-601e961d411c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:57.490062 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5609b99-7bf4-4fab-9333-601e961d411c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:57.491385 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5609b99-7bf4-4fab-9333-601e961d411c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:57.492308 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5609b99-7bf4-4fab-9333-601e961d411c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:57.750570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b73d3c56-5cf2-4f86-92ad-cd87e5517981 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:57.752873 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a5609b99-7bf4-4fab-9333-601e961d411c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:57.762569 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b73d3c56-5cf2-4f86-92ad-cd87e5517981 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.342643 Apr 12 16:19:57.764052 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a5609b99-7bf4-4fab-9333-601e961d411c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.292742 Apr 12 16:19:57.766108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 107/221] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:57 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:57.772786 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 115/222] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:57 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:58.780309 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6f9f311e-f563-432d-9cee-bb42f61d2a70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:58.780875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-63504bca-8eb4-4957-809e-efb0a3fd5c2b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:58.781233 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6f9f311e-f563-432d-9cee-bb42f61d2a70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:58.781321 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-63504bca-8eb4-4957-809e-efb0a3fd5c2b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:19:58.787489 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-63504bca-8eb4-4957-809e-efb0a3fd5c2b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:58.787947 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-63504bca-8eb4-4957-809e-efb0a3fd5c2b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:58.788704 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-63504bca-8eb4-4957-809e-efb0a3fd5c2b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:58.789150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-63504bca-8eb4-4957-809e-efb0a3fd5c2b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:58.790303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f9f311e-f563-432d-9cee-bb42f61d2a70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:58.790899 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f9f311e-f563-432d-9cee-bb42f61d2a70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:58.791730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f9f311e-f563-432d-9cee-bb42f61d2a70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:19:58.792164 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f9f311e-f563-432d-9cee-bb42f61d2a70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:19:58.993203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6f9f311e-f563-432d-9cee-bb42f61d2a70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:59.000655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6f9f311e-f563-432d-9cee-bb42f61d2a70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.224164 Apr 12 16:19:59.002182 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 108/223] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:58 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:59.016816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-63504bca-8eb4-4957-809e-efb0a3fd5c2b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:19:59.024616 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-63504bca-8eb4-4957-809e-efb0a3fd5c2b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.247703 Apr 12 16:19:59.025238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 116/224] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:19:58 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:00.018779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-56aebd5b-f67f-406d-bad8-c01346d1e93a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:00.019680 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-56aebd5b-f67f-406d-bad8-c01346d1e93a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:00.027853 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-56aebd5b-f67f-406d-bad8-c01346d1e93a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:00.028334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-56aebd5b-f67f-406d-bad8-c01346d1e93a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:00.029173 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-56aebd5b-f67f-406d-bad8-c01346d1e93a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:00.029603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-56aebd5b-f67f-406d-bad8-c01346d1e93a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:00.043111 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b6755e3a-cac3-4cfe-9fb7-5e147a60b953 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:00.043937 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b6755e3a-cac3-4cfe-9fb7-5e147a60b953 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:00.050560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b6755e3a-cac3-4cfe-9fb7-5e147a60b953 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:00.051010 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b6755e3a-cac3-4cfe-9fb7-5e147a60b953 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:00.051799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b6755e3a-cac3-4cfe-9fb7-5e147a60b953 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:00.052618 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b6755e3a-cac3-4cfe-9fb7-5e147a60b953 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:00.234562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-56aebd5b-f67f-406d-bad8-c01346d1e93a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:00.238503 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b6755e3a-cac3-4cfe-9fb7-5e147a60b953 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:00.243297 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-56aebd5b-f67f-406d-bad8-c01346d1e93a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.228386 Apr 12 16:20:00.244504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 109/225] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:00 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:00.255862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b6755e3a-cac3-4cfe-9fb7-5e147a60b953 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.217720 Apr 12 16:20:00.256650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 117/226] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:00 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:01.262477 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-31070822-2bfe-4a09-be3f-30a79cc4202d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:01.263255 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-31070822-2bfe-4a09-be3f-30a79cc4202d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:01.270290 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-31070822-2bfe-4a09-be3f-30a79cc4202d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:01.270769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-31070822-2bfe-4a09-be3f-30a79cc4202d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:01.271542 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-31070822-2bfe-4a09-be3f-30a79cc4202d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:01.271964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-31070822-2bfe-4a09-be3f-30a79cc4202d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:01.273860 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-364a0a32-9e52-4f87-ba8d-60ed31bfd36c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:01.274761 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-364a0a32-9e52-4f87-ba8d-60ed31bfd36c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:01.281321 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-364a0a32-9e52-4f87-ba8d-60ed31bfd36c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:01.281820 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-364a0a32-9e52-4f87-ba8d-60ed31bfd36c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:01.282578 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-364a0a32-9e52-4f87-ba8d-60ed31bfd36c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:01.283015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-364a0a32-9e52-4f87-ba8d-60ed31bfd36c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:01.467851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-31070822-2bfe-4a09-be3f-30a79cc4202d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:01.476625 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-31070822-2bfe-4a09-be3f-30a79cc4202d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.219209 Apr 12 16:20:01.477498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 110/227] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:01 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:01.481669 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-364a0a32-9e52-4f87-ba8d-60ed31bfd36c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:01.501237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-364a0a32-9e52-4f87-ba8d-60ed31bfd36c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.231697 Apr 12 16:20:01.501811 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 118/228] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:01 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:02.494026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2ef873f1-ee22-4063-a1a7-a73a473653a8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:02.494680 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2ef873f1-ee22-4063-a1a7-a73a473653a8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:02.500975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ef873f1-ee22-4063-a1a7-a73a473653a8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:02.501425 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ef873f1-ee22-4063-a1a7-a73a473653a8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:02.502203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ef873f1-ee22-4063-a1a7-a73a473653a8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:02.502633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ef873f1-ee22-4063-a1a7-a73a473653a8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:02.520189 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-190817e7-af18-41de-b139-af542acfaa12 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:02.521841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-190817e7-af18-41de-b139-af542acfaa12 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:02.527797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-190817e7-af18-41de-b139-af542acfaa12 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:02.528606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-190817e7-af18-41de-b139-af542acfaa12 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:02.529553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-190817e7-af18-41de-b139-af542acfaa12 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:02.530218 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-190817e7-af18-41de-b139-af542acfaa12 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:02.710539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2ef873f1-ee22-4063-a1a7-a73a473653a8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:02.718366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2ef873f1-ee22-4063-a1a7-a73a473653a8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.229179 Apr 12 16:20:02.719331 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 111/229] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:02 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:02.721823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-190817e7-af18-41de-b139-af542acfaa12 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:02.730746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-190817e7-af18-41de-b139-af542acfaa12 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.216294 Apr 12 16:20:02.731326 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 119/230] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:02 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:03.735756 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9b643f9c-e61f-4086-97a9-1ff86c0dc2a2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:03.736379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9b643f9c-e61f-4086-97a9-1ff86c0dc2a2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:03.743646 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9b643f9c-e61f-4086-97a9-1ff86c0dc2a2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:03.744176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9b643f9c-e61f-4086-97a9-1ff86c0dc2a2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:03.744869 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9b643f9c-e61f-4086-97a9-1ff86c0dc2a2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:03.745298 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9b643f9c-e61f-4086-97a9-1ff86c0dc2a2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:03.747771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-10e9ffb2-a20f-46db-96ec-983d794b81d4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:03.749013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-10e9ffb2-a20f-46db-96ec-983d794b81d4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:03.755356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-10e9ffb2-a20f-46db-96ec-983d794b81d4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:03.755858 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-10e9ffb2-a20f-46db-96ec-983d794b81d4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:03.756669 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-10e9ffb2-a20f-46db-96ec-983d794b81d4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:03.757103 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-10e9ffb2-a20f-46db-96ec-983d794b81d4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:03.937601 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9b643f9c-e61f-4086-97a9-1ff86c0dc2a2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:03.945353 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9b643f9c-e61f-4086-97a9-1ff86c0dc2a2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.213871 Apr 12 16:20:03.945973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 112/231] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:03 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:03.951077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-10e9ffb2-a20f-46db-96ec-983d794b81d4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:03.961141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-10e9ffb2-a20f-46db-96ec-983d794b81d4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.217056 Apr 12 16:20:03.961691 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 120/232] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:03 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:04.965516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ae9f557c-bef8-49ca-b5ff-693fa6781e4e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:04.966070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ae9f557c-bef8-49ca-b5ff-693fa6781e4e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:04.973507 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae9f557c-bef8-49ca-b5ff-693fa6781e4e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:04.974030 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae9f557c-bef8-49ca-b5ff-693fa6781e4e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:04.975516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae9f557c-bef8-49ca-b5ff-693fa6781e4e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:04.976071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae9f557c-bef8-49ca-b5ff-693fa6781e4e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:04.978231 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-18535081-213e-4aba-9562-210558f7f37d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:04.979028 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-18535081-213e-4aba-9562-210558f7f37d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:04.985695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18535081-213e-4aba-9562-210558f7f37d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:04.986193 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18535081-213e-4aba-9562-210558f7f37d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:04.987019 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18535081-213e-4aba-9562-210558f7f37d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:04.987477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18535081-213e-4aba-9562-210558f7f37d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:05.199926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ae9f557c-bef8-49ca-b5ff-693fa6781e4e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:05.210764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ae9f557c-bef8-49ca-b5ff-693fa6781e4e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.251025 Apr 12 16:20:05.211697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-18535081-213e-4aba-9562-210558f7f37d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:05.211869 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 113/233] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:04 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:05.220793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-18535081-213e-4aba-9562-210558f7f37d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.246941 Apr 12 16:20:05.221679 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 121/234] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:04 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:06.230125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-da8f468c-cd26-468c-b802-32858a040885 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:06.230700 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-da8f468c-cd26-468c-b802-32858a040885 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:06.239568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-81e2338c-e051-4166-801d-c8c0d8403e37 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:06.240333 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-da8f468c-cd26-468c-b802-32858a040885 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:06.240635 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-da8f468c-cd26-468c-b802-32858a040885 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:06.241480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-da8f468c-cd26-468c-b802-32858a040885 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:06.241888 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-da8f468c-cd26-468c-b802-32858a040885 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:06.246710 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-81e2338c-e051-4166-801d-c8c0d8403e37 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:06.253020 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-81e2338c-e051-4166-801d-c8c0d8403e37 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:06.254110 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-81e2338c-e051-4166-801d-c8c0d8403e37 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:06.254257 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-81e2338c-e051-4166-801d-c8c0d8403e37 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:06.254713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-81e2338c-e051-4166-801d-c8c0d8403e37 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:06.447059 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-da8f468c-cd26-468c-b802-32858a040885 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:06.456921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-81e2338c-e051-4166-801d-c8c0d8403e37 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:06.460026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-da8f468c-cd26-468c-b802-32858a040885 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.234818 Apr 12 16:20:06.468263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-81e2338c-e051-4166-801d-c8c0d8403e37 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.232807 Apr 12 16:20:06.468908 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 122/235] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:06 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:06.470728 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 114/236] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:06 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:07.479381 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5b293eca-c331-4cb5-b463-b175ea3a2c03 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:07.479982 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5b293eca-c331-4cb5-b463-b175ea3a2c03 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:07.485964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d80cf117-2e39-4308-bafa-8b9ea1ebf0d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:07.486749 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d80cf117-2e39-4308-bafa-8b9ea1ebf0d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:07.487817 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b293eca-c331-4cb5-b463-b175ea3a2c03 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:07.488306 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b293eca-c331-4cb5-b463-b175ea3a2c03 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:07.489066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b293eca-c331-4cb5-b463-b175ea3a2c03 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:07.489620 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b293eca-c331-4cb5-b463-b175ea3a2c03 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:07.493230 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d80cf117-2e39-4308-bafa-8b9ea1ebf0d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:07.493715 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d80cf117-2e39-4308-bafa-8b9ea1ebf0d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:07.494504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d80cf117-2e39-4308-bafa-8b9ea1ebf0d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:07.495166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d80cf117-2e39-4308-bafa-8b9ea1ebf0d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:07.695794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5b293eca-c331-4cb5-b463-b175ea3a2c03 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:07.703267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5b293eca-c331-4cb5-b463-b175ea3a2c03 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.227859 Apr 12 16:20:07.703857 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 123/237] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:07 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:07.725583 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d80cf117-2e39-4308-bafa-8b9ea1ebf0d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:07.733626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d80cf117-2e39-4308-bafa-8b9ea1ebf0d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.251373 Apr 12 16:20:07.734460 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 115/238] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:07 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:08.721435 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-df64085c-c349-4669-9cf1-3e30062ff29e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:08.722114 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-df64085c-c349-4669-9cf1-3e30062ff29e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:08.728753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-df64085c-c349-4669-9cf1-3e30062ff29e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:08.729204 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-df64085c-c349-4669-9cf1-3e30062ff29e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:08.730013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-df64085c-c349-4669-9cf1-3e30062ff29e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:08.730502 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-df64085c-c349-4669-9cf1-3e30062ff29e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:08.751795 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6b1889fd-01f2-4ba9-b0f9-519942f8e2a4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:08.753188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6b1889fd-01f2-4ba9-b0f9-519942f8e2a4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:08.760184 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b1889fd-01f2-4ba9-b0f9-519942f8e2a4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:08.760635 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b1889fd-01f2-4ba9-b0f9-519942f8e2a4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:08.761408 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b1889fd-01f2-4ba9-b0f9-519942f8e2a4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:08.762720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b1889fd-01f2-4ba9-b0f9-519942f8e2a4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:08.911818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-df64085c-c349-4669-9cf1-3e30062ff29e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:08.919478 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-df64085c-c349-4669-9cf1-3e30062ff29e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.201916 Apr 12 16:20:08.920017 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 124/239] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:08 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:08.934696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6b1889fd-01f2-4ba9-b0f9-519942f8e2a4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:08.942639 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6b1889fd-01f2-4ba9-b0f9-519942f8e2a4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.194561 Apr 12 16:20:08.943387 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 116/240] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:08 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:09.940431 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8c826ebb-973e-4fe7-90b8-1cdebda7235a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:09.941056 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8c826ebb-973e-4fe7-90b8-1cdebda7235a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:09.947817 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c826ebb-973e-4fe7-90b8-1cdebda7235a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:09.948250 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c826ebb-973e-4fe7-90b8-1cdebda7235a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:09.949058 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c826ebb-973e-4fe7-90b8-1cdebda7235a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:09.949575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c826ebb-973e-4fe7-90b8-1cdebda7235a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:09.961730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b2355fbd-1aa2-4096-a948-dd8d4237a93b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:09.962363 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b2355fbd-1aa2-4096-a948-dd8d4237a93b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:09.969556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b2355fbd-1aa2-4096-a948-dd8d4237a93b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:09.970277 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b2355fbd-1aa2-4096-a948-dd8d4237a93b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:09.971061 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b2355fbd-1aa2-4096-a948-dd8d4237a93b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:09.971493 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b2355fbd-1aa2-4096-a948-dd8d4237a93b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:10.159263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8c826ebb-973e-4fe7-90b8-1cdebda7235a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:10.167465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8c826ebb-973e-4fe7-90b8-1cdebda7235a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.233195 Apr 12 16:20:10.168361 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 125/241] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:09 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:10.174416 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b2355fbd-1aa2-4096-a948-dd8d4237a93b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:10.181821 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b2355fbd-1aa2-4096-a948-dd8d4237a93b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.224945 Apr 12 16:20:10.182436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 117/242] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:09 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:11.184987 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c7ca5ee7-9f2d-4ea2-bee5-3c4018d1af04 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:11.185690 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c7ca5ee7-9f2d-4ea2-bee5-3c4018d1af04 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:11.191819 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ee7-9f2d-4ea2-bee5-3c4018d1af04 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:11.192273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ee7-9f2d-4ea2-bee5-3c4018d1af04 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:11.193163 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ee7-9f2d-4ea2-bee5-3c4018d1af04 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:11.193653 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ee7-9f2d-4ea2-bee5-3c4018d1af04 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:11.199437 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-68868a31-1283-4c9f-a0f5-8cb881cb47c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:11.200166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-68868a31-1283-4c9f-a0f5-8cb881cb47c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:11.219673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68868a31-1283-4c9f-a0f5-8cb881cb47c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:11.220407 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68868a31-1283-4c9f-a0f5-8cb881cb47c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:11.221376 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68868a31-1283-4c9f-a0f5-8cb881cb47c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:11.222071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68868a31-1283-4c9f-a0f5-8cb881cb47c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:11.520896 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c7ca5ee7-9f2d-4ea2-bee5-3c4018d1af04 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:11.536620 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c7ca5ee7-9f2d-4ea2-bee5-3c4018d1af04 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.355074 Apr 12 16:20:11.537936 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 126/243] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:11 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:11.542695 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-68868a31-1283-4c9f-a0f5-8cb881cb47c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:11.550344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-68868a31-1283-4c9f-a0f5-8cb881cb47c2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.354949 Apr 12 16:20:11.566251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 118/244] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:11 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:12.554087 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ea3e5760-dc73-4087-9929-a75d830f3fd3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:12.555155 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ea3e5760-dc73-4087-9929-a75d830f3fd3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:12.562102 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ea3e5760-dc73-4087-9929-a75d830f3fd3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:12.562593 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ea3e5760-dc73-4087-9929-a75d830f3fd3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:12.563442 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ea3e5760-dc73-4087-9929-a75d830f3fd3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:12.564031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ea3e5760-dc73-4087-9929-a75d830f3fd3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:12.569254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bce3f868-abba-4816-a292-f1efb7fae6ef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:12.569944 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bce3f868-abba-4816-a292-f1efb7fae6ef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:12.577911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bce3f868-abba-4816-a292-f1efb7fae6ef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:12.577911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bce3f868-abba-4816-a292-f1efb7fae6ef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:12.578737 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bce3f868-abba-4816-a292-f1efb7fae6ef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:12.579133 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bce3f868-abba-4816-a292-f1efb7fae6ef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:12.793461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ea3e5760-dc73-4087-9929-a75d830f3fd3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:12.802216 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ea3e5760-dc73-4087-9929-a75d830f3fd3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.251969 Apr 12 16:20:12.802972 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 127/245] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:12 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:12.819245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bce3f868-abba-4816-a292-f1efb7fae6ef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:12.826742 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bce3f868-abba-4816-a292-f1efb7fae6ef tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.261856 Apr 12 16:20:12.834665 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 119/246] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:12 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:13.819950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d33b5b39-4fa6-473a-acd2-104d06408b9b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:13.820619 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d33b5b39-4fa6-473a-acd2-104d06408b9b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:13.830235 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d33b5b39-4fa6-473a-acd2-104d06408b9b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:13.830874 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d33b5b39-4fa6-473a-acd2-104d06408b9b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:13.832533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d33b5b39-4fa6-473a-acd2-104d06408b9b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:13.833496 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d33b5b39-4fa6-473a-acd2-104d06408b9b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:13.859462 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c477a489-0177-4362-acd7-d3981e88110b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:13.860092 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c477a489-0177-4362-acd7-d3981e88110b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:13.881738 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c477a489-0177-4362-acd7-d3981e88110b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:13.882536 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c477a489-0177-4362-acd7-d3981e88110b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:13.883502 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c477a489-0177-4362-acd7-d3981e88110b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:13.884091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c477a489-0177-4362-acd7-d3981e88110b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:14.298602 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d33b5b39-4fa6-473a-acd2-104d06408b9b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:14.309774 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d33b5b39-4fa6-473a-acd2-104d06408b9b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.493240 Apr 12 16:20:14.310642 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 128/247] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:13 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:14.319758 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c477a489-0177-4362-acd7-d3981e88110b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:14.328222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c477a489-0177-4362-acd7-d3981e88110b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.487722 Apr 12 16:20:14.329208 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-2da70379-89bc-4619-b317-2be374f3b77e req-83f6d0f8-0ef1-42d3-8c08-02ecfa1b0498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74711e3a-cd18-4260-b9d1-7f393f377971", "tag": "94c5c57b-adf1-460f-930c-36fd03392889"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:14.338453 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 120/248] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:13 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:14.346782 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2da70379-89bc-4619-b317-2be374f3b77e req-83f6d0f8-0ef1-42d3-8c08-02ecfa1b0498 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:14.347223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2da70379-89bc-4619-b317-2be374f3b77e req-83f6d0f8-0ef1-42d3-8c08-02ecfa1b0498 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:14.368064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-2da70379-89bc-4619-b317-2be374f3b77e req-83f6d0f8-0ef1-42d3-8c08-02ecfa1b0498 service nova] Creating event network-changed:94c5c57b-adf1-460f-930c-36fd03392889 for instance 74711e3a-cd18-4260-b9d1-7f393f377971 on hv-cinder-83752 Apr 12 16:20:14.377422 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-2da70379-89bc-4619-b317-2be374f3b77e req-83f6d0f8-0ef1-42d3-8c08-02ecfa1b0498 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064550 Apr 12 16:20:14.377986 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 129/249] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:15.327213 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-22f4df19-a545-4d5a-9027-84812211180f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:15.327819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-22f4df19-a545-4d5a-9027-84812211180f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:15.334792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-22f4df19-a545-4d5a-9027-84812211180f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:15.335240 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-22f4df19-a545-4d5a-9027-84812211180f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:15.335998 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-22f4df19-a545-4d5a-9027-84812211180f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:15.336425 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-22f4df19-a545-4d5a-9027-84812211180f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:15.345427 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-09d11cf3-1ed1-4a65-b74a-10ebf0d91c3e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:15.346809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-09d11cf3-1ed1-4a65-b74a-10ebf0d91c3e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:15.356350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-09d11cf3-1ed1-4a65-b74a-10ebf0d91c3e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:15.357031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-09d11cf3-1ed1-4a65-b74a-10ebf0d91c3e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:15.358167 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-09d11cf3-1ed1-4a65-b74a-10ebf0d91c3e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:15.358601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-09d11cf3-1ed1-4a65-b74a-10ebf0d91c3e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:15.769752 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-22f4df19-a545-4d5a-9027-84812211180f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:15.776981 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-09d11cf3-1ed1-4a65-b74a-10ebf0d91c3e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:15.780366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-22f4df19-a545-4d5a-9027-84812211180f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.456719 Apr 12 16:20:15.781483 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 121/250] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:15 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:15.784731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-09d11cf3-1ed1-4a65-b74a-10ebf0d91c3e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.443309 Apr 12 16:20:15.785322 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 130/251] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:15 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:16.808550 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-73b20b2d-fa85-49c9-9103-5cd1a7537e81 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:16.810175 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c05781d8-0708-428d-89bf-8018fa8325d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:16.811961 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-73b20b2d-fa85-49c9-9103-5cd1a7537e81 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:16.812870 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c05781d8-0708-428d-89bf-8018fa8325d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:16.827798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c05781d8-0708-428d-89bf-8018fa8325d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:16.828373 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73b20b2d-fa85-49c9-9103-5cd1a7537e81 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:16.829067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73b20b2d-fa85-49c9-9103-5cd1a7537e81 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:16.830183 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73b20b2d-fa85-49c9-9103-5cd1a7537e81 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:16.830718 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c05781d8-0708-428d-89bf-8018fa8325d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:16.831504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73b20b2d-fa85-49c9-9103-5cd1a7537e81 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:16.832744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c05781d8-0708-428d-89bf-8018fa8325d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:16.834590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c05781d8-0708-428d-89bf-8018fa8325d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:17.112772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-73b20b2d-fa85-49c9-9103-5cd1a7537e81 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:17.116888 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c05781d8-0708-428d-89bf-8018fa8325d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:17.133441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-73b20b2d-fa85-49c9-9103-5cd1a7537e81 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.328362 Apr 12 16:20:17.134386 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 131/252] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:16 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:17.137496 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c05781d8-0708-428d-89bf-8018fa8325d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.343020 Apr 12 16:20:17.138431 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 122/253] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:16 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:18.153666 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-dda42c3c-582f-4a20-8cca-910badcf3671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:18.154935 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-dda42c3c-582f-4a20-8cca-910badcf3671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:18.155708 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7fbe723c-af97-43c9-ac44-581c7fe17165 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:18.156673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7fbe723c-af97-43c9-ac44-581c7fe17165 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:18.163436 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dda42c3c-582f-4a20-8cca-910badcf3671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:18.164273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dda42c3c-582f-4a20-8cca-910badcf3671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:18.165735 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7fbe723c-af97-43c9-ac44-581c7fe17165 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:18.165960 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dda42c3c-582f-4a20-8cca-910badcf3671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:18.167012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7fbe723c-af97-43c9-ac44-581c7fe17165 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:18.167767 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dda42c3c-582f-4a20-8cca-910badcf3671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:18.169026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7fbe723c-af97-43c9-ac44-581c7fe17165 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:18.169641 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7fbe723c-af97-43c9-ac44-581c7fe17165 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:18.443877 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7fbe723c-af97-43c9-ac44-581c7fe17165 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:18.456892 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7fbe723c-af97-43c9-ac44-581c7fe17165 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.306055 Apr 12 16:20:18.459350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 123/254] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:18 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:18.500909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dda42c3c-582f-4a20-8cca-910badcf3671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:18.510345 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-dda42c3c-582f-4a20-8cca-910badcf3671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.361692 Apr 12 16:20:18.521803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 132/255] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:18 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:19.476357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6026916d-3419-47b9-a000-7f107e55f657 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:19.477229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6026916d-3419-47b9-a000-7f107e55f657 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:19.495655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6026916d-3419-47b9-a000-7f107e55f657 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:19.496424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6026916d-3419-47b9-a000-7f107e55f657 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:19.503625 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6026916d-3419-47b9-a000-7f107e55f657 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:19.504232 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6026916d-3419-47b9-a000-7f107e55f657 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:19.528498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e6053ea6-950f-4010-af03-fe94a2437c97 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:19.529200 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e6053ea6-950f-4010-af03-fe94a2437c97 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:19.539474 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e6053ea6-950f-4010-af03-fe94a2437c97 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:19.540127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e6053ea6-950f-4010-af03-fe94a2437c97 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:19.541075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e6053ea6-950f-4010-af03-fe94a2437c97 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:19.544394 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e6053ea6-950f-4010-af03-fe94a2437c97 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:19.756044 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6026916d-3419-47b9-a000-7f107e55f657 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:19.760064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e6053ea6-950f-4010-af03-fe94a2437c97 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:19.774987 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6026916d-3419-47b9-a000-7f107e55f657 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.303701 Apr 12 16:20:19.777509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e6053ea6-950f-4010-af03-fe94a2437c97 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.252699 Apr 12 16:20:19.788633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 124/256] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:19 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:19.788989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 133/257] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:19 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:20.796799 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8217fc01-f1fc-4cf2-8d5b-343fb7eb9356 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:20.797439 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8217fc01-f1fc-4cf2-8d5b-343fb7eb9356 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:20.805057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-abe49b2d-a5a9-482f-9615-cae333f03cd6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:20.805676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-abe49b2d-a5a9-482f-9615-cae333f03cd6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:20.819480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-abe49b2d-a5a9-482f-9615-cae333f03cd6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:20.820014 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-abe49b2d-a5a9-482f-9615-cae333f03cd6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:20.820453 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8217fc01-f1fc-4cf2-8d5b-343fb7eb9356 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:20.820833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-abe49b2d-a5a9-482f-9615-cae333f03cd6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:20.820944 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8217fc01-f1fc-4cf2-8d5b-343fb7eb9356 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:20.821263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-abe49b2d-a5a9-482f-9615-cae333f03cd6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:20.825100 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8217fc01-f1fc-4cf2-8d5b-343fb7eb9356 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:20.825562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8217fc01-f1fc-4cf2-8d5b-343fb7eb9356 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:21.063417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8217fc01-f1fc-4cf2-8d5b-343fb7eb9356 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:21.072103 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8217fc01-f1fc-4cf2-8d5b-343fb7eb9356 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.280438 Apr 12 16:20:21.075040 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 125/258] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:20 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:21.119576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-abe49b2d-a5a9-482f-9615-cae333f03cd6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:21.145857 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-abe49b2d-a5a9-482f-9615-cae333f03cd6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.340241 Apr 12 16:20:21.147753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 134/259] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:20 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:22.093486 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-685cadc1-bfed-48d3-ad58-bccb14e22ac7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:22.094713 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-685cadc1-bfed-48d3-ad58-bccb14e22ac7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:22.102229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-685cadc1-bfed-48d3-ad58-bccb14e22ac7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:22.102679 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-685cadc1-bfed-48d3-ad58-bccb14e22ac7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:22.103455 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-685cadc1-bfed-48d3-ad58-bccb14e22ac7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:22.103891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-685cadc1-bfed-48d3-ad58-bccb14e22ac7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:22.165493 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e3b0fedc-6adb-422a-8f87-b53c292c7088 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:22.167228 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e3b0fedc-6adb-422a-8f87-b53c292c7088 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:22.177837 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e3b0fedc-6adb-422a-8f87-b53c292c7088 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:22.178743 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e3b0fedc-6adb-422a-8f87-b53c292c7088 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:22.180667 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e3b0fedc-6adb-422a-8f87-b53c292c7088 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:22.181320 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e3b0fedc-6adb-422a-8f87-b53c292c7088 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:22.281696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-685cadc1-bfed-48d3-ad58-bccb14e22ac7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:22.301151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-685cadc1-bfed-48d3-ad58-bccb14e22ac7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.212306 Apr 12 16:20:22.312340 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 126/260] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:22 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:22.345673 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e3b0fedc-6adb-422a-8f87-b53c292c7088 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:22.353818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e3b0fedc-6adb-422a-8f87-b53c292c7088 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.193575 Apr 12 16:20:22.355210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 135/261] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:22 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:23.319774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1e6baf79-c4d7-4f05-b5d8-92e5b4b2b128 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:23.320597 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1e6baf79-c4d7-4f05-b5d8-92e5b4b2b128 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:23.330113 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e6baf79-c4d7-4f05-b5d8-92e5b4b2b128 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:23.330790 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e6baf79-c4d7-4f05-b5d8-92e5b4b2b128 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:23.331566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e6baf79-c4d7-4f05-b5d8-92e5b4b2b128 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:23.332144 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e6baf79-c4d7-4f05-b5d8-92e5b4b2b128 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:23.374998 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-00b752e4-6f98-46a8-9d0e-dd70bcd35f92 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:23.377758 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-00b752e4-6f98-46a8-9d0e-dd70bcd35f92 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:23.389271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-00b752e4-6f98-46a8-9d0e-dd70bcd35f92 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:23.389674 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-00b752e4-6f98-46a8-9d0e-dd70bcd35f92 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:23.390613 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-00b752e4-6f98-46a8-9d0e-dd70bcd35f92 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:23.396538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-00b752e4-6f98-46a8-9d0e-dd70bcd35f92 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:23.662167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1e6baf79-c4d7-4f05-b5d8-92e5b4b2b128 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:23.684084 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1e6baf79-c4d7-4f05-b5d8-92e5b4b2b128 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.368170 Apr 12 16:20:23.684598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 127/262] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:23 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:23.718771 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-f1337c38-78b4-4fab-a21b-299bef2204f1 req-a059cc05-9207-4cce-85fe-2e22745c8881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74711e3a-cd18-4260-b9d1-7f393f377971", "name": "network-vif-plugged", "status": "completed", "tag": "94c5c57b-adf1-460f-930c-36fd03392889"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:23.744434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-f1337c38-78b4-4fab-a21b-299bef2204f1 req-a059cc05-9207-4cce-85fe-2e22745c8881 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:23.746376 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-f1337c38-78b4-4fab-a21b-299bef2204f1 req-a059cc05-9207-4cce-85fe-2e22745c8881 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:23.782819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-f1337c38-78b4-4fab-a21b-299bef2204f1 req-a059cc05-9207-4cce-85fe-2e22745c8881 service nova] Creating event network-vif-plugged:94c5c57b-adf1-460f-930c-36fd03392889 for instance 74711e3a-cd18-4260-b9d1-7f393f377971 on hv-cinder-83752 Apr 12 16:20:23.792938 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-f1337c38-78b4-4fab-a21b-299bef2204f1 req-a059cc05-9207-4cce-85fe-2e22745c8881 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092154 Apr 12 16:20:23.794296 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 128/263] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:23.830614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-00b752e4-6f98-46a8-9d0e-dd70bcd35f92 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:23.845174 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-00b752e4-6f98-46a8-9d0e-dd70bcd35f92 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.477928 Apr 12 16:20:23.851893 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 136/264] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:23 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:24.703845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1e820100-d756-4ade-8f0d-9d4455abe04d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:24.707283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1e820100-d756-4ade-8f0d-9d4455abe04d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:24.721166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e820100-d756-4ade-8f0d-9d4455abe04d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:24.723001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e820100-d756-4ade-8f0d-9d4455abe04d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:24.724726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e820100-d756-4ade-8f0d-9d4455abe04d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:24.725325 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e820100-d756-4ade-8f0d-9d4455abe04d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:24.864339 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4927f23d-a9c5-48c9-957e-87a0d482d223 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:24.865083 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4927f23d-a9c5-48c9-957e-87a0d482d223 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:24.874961 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4927f23d-a9c5-48c9-957e-87a0d482d223 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:24.875412 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4927f23d-a9c5-48c9-957e-87a0d482d223 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:24.882281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4927f23d-a9c5-48c9-957e-87a0d482d223 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:24.882753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4927f23d-a9c5-48c9-957e-87a0d482d223 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:25.251561 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1e820100-d756-4ade-8f0d-9d4455abe04d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:25.262442 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1e820100-d756-4ade-8f0d-9d4455abe04d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.565023 Apr 12 16:20:25.263270 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 129/265] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:24 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:25.388382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4927f23d-a9c5-48c9-957e-87a0d482d223 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:25.395946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4927f23d-a9c5-48c9-957e-87a0d482d223 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1358 microversion: 2.1 time: 0.535701 Apr 12 16:20:25.396535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 137/266] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:24 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1358 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:26.283112 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d33cbf29-7aea-4b44-bcc8-c7f24809c29b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:26.285123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d33cbf29-7aea-4b44-bcc8-c7f24809c29b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:26.324082 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d33cbf29-7aea-4b44-bcc8-c7f24809c29b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:26.325152 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d33cbf29-7aea-4b44-bcc8-c7f24809c29b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:26.326812 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d33cbf29-7aea-4b44-bcc8-c7f24809c29b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:26.328600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d33cbf29-7aea-4b44-bcc8-c7f24809c29b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:26.415807 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-59fe2276-8bdc-4024-8dd7-6263ac9eee72 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:26.417280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-59fe2276-8bdc-4024-8dd7-6263ac9eee72 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:26.429533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-59fe2276-8bdc-4024-8dd7-6263ac9eee72 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:26.436346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-59fe2276-8bdc-4024-8dd7-6263ac9eee72 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:26.443104 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-59fe2276-8bdc-4024-8dd7-6263ac9eee72 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:26.444870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-59fe2276-8bdc-4024-8dd7-6263ac9eee72 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:26.655147 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d33cbf29-7aea-4b44-bcc8-c7f24809c29b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:26.683541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d33cbf29-7aea-4b44-bcc8-c7f24809c29b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.407508 Apr 12 16:20:26.696712 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 130/267] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:26 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:26.874407 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-59fe2276-8bdc-4024-8dd7-6263ac9eee72 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:26.888346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-59fe2276-8bdc-4024-8dd7-6263ac9eee72 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1548 microversion: 2.1 time: 0.477691 Apr 12 16:20:26.906204 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 138/268] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:26 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1548 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:26.910732 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b1465b36-e4e2-4962-a5c3-3d907dee95fd tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:26.911671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b1465b36-e4e2-4962-a5c3-3d907dee95fd tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:26.919895 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b1465b36-e4e2-4962-a5c3-3d907dee95fd tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:26.920343 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b1465b36-e4e2-4962-a5c3-3d907dee95fd tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:26.921131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b1465b36-e4e2-4962-a5c3-3d907dee95fd tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:26.921565 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b1465b36-e4e2-4962-a5c3-3d907dee95fd tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:27.256763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b1465b36-e4e2-4962-a5c3-3d907dee95fd tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:27.265340 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b1465b36-e4e2-4962-a5c3-3d907dee95fd tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1548 microversion: 2.1 time: 0.361073 Apr 12 16:20:27.269222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 131/269] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:26 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1548 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:27.287349 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:27.295503 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:27.296282 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Searching by: {'deleted': False, 'project_id': 'f91e85c02b6e47d9913792e1168a8939'} {{(pid=117201) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 12 16:20:27.317495 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:27.321420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:27.323029 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:27.323623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:27.460194 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.multi_cell_list [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117201) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 16:20:27.587654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-52e1e112-2d1d-49e6-882e-26ed0339f527 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.307417 Apr 12 16:20:27.594396 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 139/270] 10.222.0.67 () {58 vars in 1124 bytes} [Tue Apr 12 16:20:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:27.601744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c15539ee-a0c1-4644-8226-da084bcf3988 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:27.603075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c15539ee-a0c1-4644-8226-da084bcf3988 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:27.612936 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c15539ee-a0c1-4644-8226-da084bcf3988 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:27.613562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c15539ee-a0c1-4644-8226-da084bcf3988 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:27.614818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c15539ee-a0c1-4644-8226-da084bcf3988 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:27.615421 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c15539ee-a0c1-4644-8226-da084bcf3988 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:27.839167 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c15539ee-a0c1-4644-8226-da084bcf3988 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:27.849158 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c15539ee-a0c1-4644-8226-da084bcf3988 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1548 microversion: 2.1 time: 0.253333 Apr 12 16:20:27.851126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 140/271] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:27 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1548 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:27.855735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3a41d35a-f8d8-466c-9067-77a57569c651 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:27.856749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3a41d35a-f8d8-466c-9067-77a57569c651 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:27.858020 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1f3963dc-518a-496a-bbe1-47090453c368 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Action: 'create', calling method: .version_select at 0x7f246e56e700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-944614855"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:27.864010 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3a41d35a-f8d8-466c-9067-77a57569c651 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:27.864699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3a41d35a-f8d8-466c-9067-77a57569c651 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:27.865995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3a41d35a-f8d8-466c-9067-77a57569c651 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:27.866603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3a41d35a-f8d8-466c-9067-77a57569c651 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:27.909224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-1f3963dc-518a-496a-bbe1-47090453c368 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for project 9efdb664508148aab946b17b16013559. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:20:27.921608 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-1f3963dc-518a-496a-bbe1-47090453c368 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for user b72b05bd57f241128f065c0b94663f6d and project 9efdb664508148aab946b17b16013559. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:20:28.088891 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3a41d35a-f8d8-466c-9067-77a57569c651 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:28.097668 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3a41d35a-f8d8-466c-9067-77a57569c651 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.245446 Apr 12 16:20:28.106004 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-1f3963dc-518a-496a-bbe1-47090453c368 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for project 9efdb664508148aab946b17b16013559. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:20:28.107800 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 141/272] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:27 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:28.114338 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-1f3963dc-518a-496a-bbe1-47090453c368 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for user b72b05bd57f241128f065c0b94663f6d and project 9efdb664508148aab946b17b16013559. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:20:28.131222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1f3963dc-518a-496a-bbe1-47090453c368 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.798607 Apr 12 16:20:28.131821 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 132/273] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:20:27 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:29.123644 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b827fffe-776c-4737-bbe8-d6a87c296f08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:29.124263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b827fffe-776c-4737-bbe8-d6a87c296f08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:29.140112 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b827fffe-776c-4737-bbe8-d6a87c296f08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:29.140566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b827fffe-776c-4737-bbe8-d6a87c296f08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:29.141358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b827fffe-776c-4737-bbe8-d6a87c296f08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:29.141789 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b827fffe-776c-4737-bbe8-d6a87c296f08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:29.290124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b827fffe-776c-4737-bbe8-d6a87c296f08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:29.298103 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b827fffe-776c-4737-bbe8-d6a87c296f08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.178433 Apr 12 16:20:29.299965 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 142/274] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:29 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:30.317214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a88de1a2-9673-491b-b71c-d47460b70d24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:30.318370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a88de1a2-9673-491b-b71c-d47460b70d24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:30.325297 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a88de1a2-9673-491b-b71c-d47460b70d24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:30.325748 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a88de1a2-9673-491b-b71c-d47460b70d24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:30.326654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a88de1a2-9673-491b-b71c-d47460b70d24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:30.327031 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a88de1a2-9673-491b-b71c-d47460b70d24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:30.480577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a88de1a2-9673-491b-b71c-d47460b70d24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:30.488599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a88de1a2-9673-491b-b71c-d47460b70d24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.175715 Apr 12 16:20:30.489163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 133/275] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:30 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:31.508916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-30ee84be-1dcc-44d0-bc4b-52a0f53432b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:31.509521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-30ee84be-1dcc-44d0-bc4b-52a0f53432b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:31.515807 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-30ee84be-1dcc-44d0-bc4b-52a0f53432b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:31.516339 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-30ee84be-1dcc-44d0-bc4b-52a0f53432b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:31.517021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-30ee84be-1dcc-44d0-bc4b-52a0f53432b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:31.517449 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-30ee84be-1dcc-44d0-bc4b-52a0f53432b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:31.662824 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-30ee84be-1dcc-44d0-bc4b-52a0f53432b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:31.670660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-30ee84be-1dcc-44d0-bc4b-52a0f53432b5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.165621 Apr 12 16:20:31.671231 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 143/276] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:31 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:32.695740 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-18c2ba5b-2e0c-48de-a276-db854dac3da5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d72b2a-32b6-4f11-916b-f548f6436140"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:32.696726 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-18c2ba5b-2e0c-48de-a276-db854dac3da5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:32.698971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-65bb63cb-fad6-4faa-a227-6b2a71e1bd79 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:32.699582 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-65bb63cb-fad6-4faa-a227-6b2a71e1bd79 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:32.702950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18c2ba5b-2e0c-48de-a276-db854dac3da5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:32.703476 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18c2ba5b-2e0c-48de-a276-db854dac3da5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:32.704392 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18c2ba5b-2e0c-48de-a276-db854dac3da5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:32.705353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18c2ba5b-2e0c-48de-a276-db854dac3da5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:32.706346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65bb63cb-fad6-4faa-a227-6b2a71e1bd79 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:32.706797 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65bb63cb-fad6-4faa-a227-6b2a71e1bd79 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:32.707558 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65bb63cb-fad6-4faa-a227-6b2a71e1bd79 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:32.708737 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65bb63cb-fad6-4faa-a227-6b2a71e1bd79 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:32.844256 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-65bb63cb-fad6-4faa-a227-6b2a71e1bd79 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:32.852524 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-65bb63cb-fad6-4faa-a227-6b2a71e1bd79 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.160439 Apr 12 16:20:32.853096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 134/277] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:32 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:33.870665 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-08dc8b44-1cb7-4080-9f8b-b0acc68e981c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:33.872094 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-08dc8b44-1cb7-4080-9f8b-b0acc68e981c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:33.889891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08dc8b44-1cb7-4080-9f8b-b0acc68e981c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:33.891274 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08dc8b44-1cb7-4080-9f8b-b0acc68e981c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:33.893298 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08dc8b44-1cb7-4080-9f8b-b0acc68e981c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:33.894584 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08dc8b44-1cb7-4080-9f8b-b0acc68e981c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:34.037395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-08dc8b44-1cb7-4080-9f8b-b0acc68e981c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:34.050393 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-08dc8b44-1cb7-4080-9f8b-b0acc68e981c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.184547 Apr 12 16:20:34.051473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 135/278] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:33 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:35.074352 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-da28aab2-8837-45c3-b431-d58d378a2e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:35.075279 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-da28aab2-8837-45c3-b431-d58d378a2e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:35.082588 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-da28aab2-8837-45c3-b431-d58d378a2e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:35.083131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-da28aab2-8837-45c3-b431-d58d378a2e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:35.083908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-da28aab2-8837-45c3-b431-d58d378a2e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:35.084342 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-da28aab2-8837-45c3-b431-d58d378a2e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:35.232830 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-da28aab2-8837-45c3-b431-d58d378a2e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:35.253268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-da28aab2-8837-45c3-b431-d58d378a2e25 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.183468 Apr 12 16:20:35.258576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 136/279] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:35 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:36.272078 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cc416114-f5c1-4a31-a336-24f4673e7deb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:36.272714 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cc416114-f5c1-4a31-a336-24f4673e7deb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:36.279182 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc416114-f5c1-4a31-a336-24f4673e7deb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:36.279620 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc416114-f5c1-4a31-a336-24f4673e7deb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:36.280392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc416114-f5c1-4a31-a336-24f4673e7deb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:36.280829 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc416114-f5c1-4a31-a336-24f4673e7deb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:36.383761 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-18c2ba5b-2e0c-48de-a276-db854dac3da5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "POST /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.692574 Apr 12 16:20:36.384461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 144/280] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:20:32 2022] POST /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments => generated 194 bytes in 3694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:36.427709 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cc416114-f5c1-4a31-a336-24f4673e7deb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:36.437587 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cc416114-f5c1-4a31-a336-24f4673e7deb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.169667 Apr 12 16:20:36.438192 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 137/281] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:36 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:37.455849 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-95ef232d-d8e3-453f-b8c7-81c902f0f892 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:37.456567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-95ef232d-d8e3-453f-b8c7-81c902f0f892 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:37.469104 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-95ef232d-d8e3-453f-b8c7-81c902f0f892 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:37.469104 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-95ef232d-d8e3-453f-b8c7-81c902f0f892 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:37.469104 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-95ef232d-d8e3-453f-b8c7-81c902f0f892 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:37.469104 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-95ef232d-d8e3-453f-b8c7-81c902f0f892 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:37.612270 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-95ef232d-d8e3-453f-b8c7-81c902f0f892 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:37.622031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-95ef232d-d8e3-453f-b8c7-81c902f0f892 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.170692 Apr 12 16:20:37.622636 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 145/282] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:37 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:38.639461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6b56df18-9ae3-4fd3-975a-ad2df3074058 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:38.640188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6b56df18-9ae3-4fd3-975a-ad2df3074058 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:38.647267 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b56df18-9ae3-4fd3-975a-ad2df3074058 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:38.647720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b56df18-9ae3-4fd3-975a-ad2df3074058 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:38.648490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b56df18-9ae3-4fd3-975a-ad2df3074058 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:38.648954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6b56df18-9ae3-4fd3-975a-ad2df3074058 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:38.797381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6b56df18-9ae3-4fd3-975a-ad2df3074058 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:38.805911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6b56df18-9ae3-4fd3-975a-ad2df3074058 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.170356 Apr 12 16:20:38.806451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 138/283] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:38 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:39.823532 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ac50488c-c763-4530-a6be-46f0f1b7c431 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:39.824152 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ac50488c-c763-4530-a6be-46f0f1b7c431 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:39.830916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ac50488c-c763-4530-a6be-46f0f1b7c431 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:39.831372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ac50488c-c763-4530-a6be-46f0f1b7c431 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:39.832162 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ac50488c-c763-4530-a6be-46f0f1b7c431 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:39.832591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ac50488c-c763-4530-a6be-46f0f1b7c431 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:39.977789 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ac50488c-c763-4530-a6be-46f0f1b7c431 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:39.987237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ac50488c-c763-4530-a6be-46f0f1b7c431 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.167663 Apr 12 16:20:39.988024 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 146/284] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:39 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:41.005076 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bc4edd49-7226-492e-a0b1-68be8a4983b7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:41.005945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bc4edd49-7226-492e-a0b1-68be8a4983b7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:41.012517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bc4edd49-7226-492e-a0b1-68be8a4983b7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:41.012961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bc4edd49-7226-492e-a0b1-68be8a4983b7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:41.013728 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bc4edd49-7226-492e-a0b1-68be8a4983b7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:41.014181 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bc4edd49-7226-492e-a0b1-68be8a4983b7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:41.159741 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bc4edd49-7226-492e-a0b1-68be8a4983b7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:41.168683 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bc4edd49-7226-492e-a0b1-68be8a4983b7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.167939 Apr 12 16:20:41.169262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 139/285] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:40 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:42.186843 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-883cc780-8ea6-4bb5-a28d-b661f0e10375 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:42.187606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-883cc780-8ea6-4bb5-a28d-b661f0e10375 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:42.194593 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-883cc780-8ea6-4bb5-a28d-b661f0e10375 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:42.195057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-883cc780-8ea6-4bb5-a28d-b661f0e10375 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:42.195825 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-883cc780-8ea6-4bb5-a28d-b661f0e10375 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:42.196476 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-883cc780-8ea6-4bb5-a28d-b661f0e10375 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:42.335214 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-883cc780-8ea6-4bb5-a28d-b661f0e10375 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:42.343827 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-883cc780-8ea6-4bb5-a28d-b661f0e10375 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.161115 Apr 12 16:20:42.345515 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 147/286] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:42 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:43.364971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-14f1798f-4250-44dc-be05-0bd7d584c3c6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:43.364971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-14f1798f-4250-44dc-be05-0bd7d584c3c6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:43.371594 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-14f1798f-4250-44dc-be05-0bd7d584c3c6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:43.372031 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-14f1798f-4250-44dc-be05-0bd7d584c3c6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:43.372925 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-14f1798f-4250-44dc-be05-0bd7d584c3c6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:43.373360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-14f1798f-4250-44dc-be05-0bd7d584c3c6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:43.608570 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-14f1798f-4250-44dc-be05-0bd7d584c3c6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:43.616533 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-14f1798f-4250-44dc-be05-0bd7d584c3c6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.256565 Apr 12 16:20:43.617457 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 140/287] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:43 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:44.635493 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4feed985-1f0e-4e1f-bc60-f593679f611e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:44.636216 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4feed985-1f0e-4e1f-bc60-f593679f611e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:44.644445 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4feed985-1f0e-4e1f-bc60-f593679f611e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:44.645018 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4feed985-1f0e-4e1f-bc60-f593679f611e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:44.646293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4feed985-1f0e-4e1f-bc60-f593679f611e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:44.646841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4feed985-1f0e-4e1f-bc60-f593679f611e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:44.783952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4feed985-1f0e-4e1f-bc60-f593679f611e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:44.792139 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4feed985-1f0e-4e1f-bc60-f593679f611e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.161681 Apr 12 16:20:44.792762 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 148/288] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:44 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:45.813510 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dd56c336-549b-4fac-a7f5-3e7b8ae5a10b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:45.814546 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dd56c336-549b-4fac-a7f5-3e7b8ae5a10b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:45.825847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dd56c336-549b-4fac-a7f5-3e7b8ae5a10b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:45.826800 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dd56c336-549b-4fac-a7f5-3e7b8ae5a10b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:45.829275 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dd56c336-549b-4fac-a7f5-3e7b8ae5a10b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:45.831151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dd56c336-549b-4fac-a7f5-3e7b8ae5a10b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:45.980546 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dd56c336-549b-4fac-a7f5-3e7b8ae5a10b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:45.987923 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dd56c336-549b-4fac-a7f5-3e7b8ae5a10b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.181262 Apr 12 16:20:45.988502 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 141/289] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:45 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:47.005180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-988f1ad6-1115-443c-b011-ddbfcce46d9e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:47.005823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-988f1ad6-1115-443c-b011-ddbfcce46d9e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:47.013345 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-988f1ad6-1115-443c-b011-ddbfcce46d9e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:47.013799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-988f1ad6-1115-443c-b011-ddbfcce46d9e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:47.014614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-988f1ad6-1115-443c-b011-ddbfcce46d9e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:47.015049 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-988f1ad6-1115-443c-b011-ddbfcce46d9e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:47.156930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-988f1ad6-1115-443c-b011-ddbfcce46d9e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:47.165430 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-988f1ad6-1115-443c-b011-ddbfcce46d9e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.164222 Apr 12 16:20:47.166054 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 149/290] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:47 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:47.553072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1158714273", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "networks": [{"uuid": "453187e0-f48e-47e4-b989-372e2d63b9b3"}]}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:47.622943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] validate_networks() for [('453187e0-f48e-47e4-b989-372e2d63b9b3', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:20:47.980262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:20:47.980666 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:20:47.981149 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:20:47.981554 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:20:47.981956 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:20:47.991286 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:47.991734 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:47.992525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:47.992954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:48.011346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Getting quotas for project 3cca5abe3a804deeb910d0d5920c6b6e. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:20:48.015939 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Getting quotas for user c63ecebba0d84bd7a2dc6e1f8b152001 and project 3cca5abe3a804deeb910d0d5920c6b6e. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:20:48.027625 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:20:48.029971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:20:48.073645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b517a244-960e-40f8-838f-b6fd9431e6c3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525168 Apr 12 16:20:48.074336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 142/291] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:20:48.085245 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4ff8495e-e47a-4d88-a197-385defe4c0c5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:48.086163 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4ff8495e-e47a-4d88-a197-385defe4c0c5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:48.154573 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4ff8495e-e47a-4d88-a197-385defe4c0c5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:48.161850 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4ff8495e-e47a-4d88-a197-385defe4c0c5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1219 microversion: 2.1 time: 0.080746 Apr 12 16:20:48.162499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 150/292] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:48 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:48.182380 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a218ac52-1f09-46d1-8fef-c143e05c8d0e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:48.182989 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a218ac52-1f09-46d1-8fef-c143e05c8d0e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:48.189185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a218ac52-1f09-46d1-8fef-c143e05c8d0e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:48.189520 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a218ac52-1f09-46d1-8fef-c143e05c8d0e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:48.190473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a218ac52-1f09-46d1-8fef-c143e05c8d0e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:48.191057 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a218ac52-1f09-46d1-8fef-c143e05c8d0e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:48.241457 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-19a0c516-8f16-4051-9dc0-046d6d7cca09 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:48.242097 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-19a0c516-8f16-4051-9dc0-046d6d7cca09 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:48.247931 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-19a0c516-8f16-4051-9dc0-046d6d7cca09 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:48.248382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-19a0c516-8f16-4051-9dc0-046d6d7cca09 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:48.249161 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-19a0c516-8f16-4051-9dc0-046d6d7cca09 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:48.249596 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-19a0c516-8f16-4051-9dc0-046d6d7cca09 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:48.400216 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a218ac52-1f09-46d1-8fef-c143e05c8d0e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:48.408151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a218ac52-1f09-46d1-8fef-c143e05c8d0e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.229675 Apr 12 16:20:48.409021 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 143/293] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:48 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:48.430862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-19a0c516-8f16-4051-9dc0-046d6d7cca09 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:48.439562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-19a0c516-8f16-4051-9dc0-046d6d7cca09 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1594 microversion: 2.1 time: 0.202096 Apr 12 16:20:48.440219 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 151/294] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:48 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1594 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:49.180288 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b48ce2b5-34af-4265-a3ef-409fb837bd6e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:49.180915 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b48ce2b5-34af-4265-a3ef-409fb837bd6e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:49.187629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b48ce2b5-34af-4265-a3ef-409fb837bd6e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:49.188091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b48ce2b5-34af-4265-a3ef-409fb837bd6e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:49.188947 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b48ce2b5-34af-4265-a3ef-409fb837bd6e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:49.189412 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b48ce2b5-34af-4265-a3ef-409fb837bd6e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:49.254864 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b48ce2b5-34af-4265-a3ef-409fb837bd6e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:49.262591 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b48ce2b5-34af-4265-a3ef-409fb837bd6e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1271 microversion: 2.1 time: 0.086799 Apr 12 16:20:49.263194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 144/295] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:49 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:49.424642 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2d80f6f7-838e-4418-87d4-4c5e55c2808d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:49.425232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2d80f6f7-838e-4418-87d4-4c5e55c2808d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:49.432415 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d80f6f7-838e-4418-87d4-4c5e55c2808d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:49.432866 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d80f6f7-838e-4418-87d4-4c5e55c2808d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:49.433634 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d80f6f7-838e-4418-87d4-4c5e55c2808d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:49.434081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d80f6f7-838e-4418-87d4-4c5e55c2808d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:49.575500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2d80f6f7-838e-4418-87d4-4c5e55c2808d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:49.584466 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2d80f6f7-838e-4418-87d4-4c5e55c2808d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1518 microversion: 2.1 time: 0.163732 Apr 12 16:20:49.585908 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 152/296] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:49 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:50.280708 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1ae09731-be85-4879-8544-65ced97f24c8 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:50.281908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1ae09731-be85-4879-8544-65ced97f24c8 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:50.288859 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ae09731-be85-4879-8544-65ced97f24c8 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:50.289404 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ae09731-be85-4879-8544-65ced97f24c8 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:50.290364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ae09731-be85-4879-8544-65ced97f24c8 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:50.291021 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ae09731-be85-4879-8544-65ced97f24c8 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:50.370008 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1ae09731-be85-4879-8544-65ced97f24c8 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:50.380573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1ae09731-be85-4879-8544-65ced97f24c8 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1279 microversion: 2.1 time: 0.103907 Apr 12 16:20:50.382350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 145/297] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:50 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:50.519877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-051641e4-a9d2-4bf9-89f9-9e2b05a8d8a0 req-52dc617d-3309-4306-bc20-e36776a84c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74711e3a-cd18-4260-b9d1-7f393f377971", "tag": "94c5c57b-adf1-460f-930c-36fd03392889"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:50.538180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-051641e4-a9d2-4bf9-89f9-9e2b05a8d8a0 req-52dc617d-3309-4306-bc20-e36776a84c86 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:50.543493 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-051641e4-a9d2-4bf9-89f9-9e2b05a8d8a0 req-52dc617d-3309-4306-bc20-e36776a84c86 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:50.572815 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-051641e4-a9d2-4bf9-89f9-9e2b05a8d8a0 req-52dc617d-3309-4306-bc20-e36776a84c86 service nova] Creating event network-changed:94c5c57b-adf1-460f-930c-36fd03392889 for instance 74711e3a-cd18-4260-b9d1-7f393f377971 on hv-cinder-83752 Apr 12 16:20:50.578348 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-051641e4-a9d2-4bf9-89f9-9e2b05a8d8a0 req-52dc617d-3309-4306-bc20-e36776a84c86 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068817 Apr 12 16:20:50.579214 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 153/298] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:50.603645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d06b25ba-42ab-4f2b-977b-1bdb3bb17ed8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:50.604795 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d06b25ba-42ab-4f2b-977b-1bdb3bb17ed8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:50.617792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d06b25ba-42ab-4f2b-977b-1bdb3bb17ed8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:50.618584 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d06b25ba-42ab-4f2b-977b-1bdb3bb17ed8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:50.619977 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d06b25ba-42ab-4f2b-977b-1bdb3bb17ed8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:50.620581 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d06b25ba-42ab-4f2b-977b-1bdb3bb17ed8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:51.341300 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d06b25ba-42ab-4f2b-977b-1bdb3bb17ed8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:51.352081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d06b25ba-42ab-4f2b-977b-1bdb3bb17ed8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1498 microversion: 2.1 time: 0.753764 Apr 12 16:20:51.353324 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 146/299] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:50 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1498 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:51.369237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2608a3e9-dbaf-4636-81f1-1f8d51c4261f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:51.370160 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2608a3e9-dbaf-4636-81f1-1f8d51c4261f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:51.376761 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2608a3e9-dbaf-4636-81f1-1f8d51c4261f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:51.377427 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2608a3e9-dbaf-4636-81f1-1f8d51c4261f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:51.378464 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2608a3e9-dbaf-4636-81f1-1f8d51c4261f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:51.379044 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2608a3e9-dbaf-4636-81f1-1f8d51c4261f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:51.399610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1dfe112e-3b77-4ed1-ba82-f57a62dca475 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:51.400524 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1dfe112e-3b77-4ed1-ba82-f57a62dca475 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:51.410381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1dfe112e-3b77-4ed1-ba82-f57a62dca475 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:51.414802 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1dfe112e-3b77-4ed1-ba82-f57a62dca475 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:51.416032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1dfe112e-3b77-4ed1-ba82-f57a62dca475 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:51.416642 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1dfe112e-3b77-4ed1-ba82-f57a62dca475 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:51.608132 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1dfe112e-3b77-4ed1-ba82-f57a62dca475 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:51.624341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1dfe112e-3b77-4ed1-ba82-f57a62dca475 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1277 microversion: 2.1 time: 0.228716 Apr 12 16:20:51.624930 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 147/300] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:51 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:51.834364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2608a3e9-dbaf-4636-81f1-1f8d51c4261f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:51.847796 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2608a3e9-dbaf-4636-81f1-1f8d51c4261f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1513 microversion: 2.1 time: 0.482822 Apr 12 16:20:51.848566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 154/301] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:51 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1513 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:52.643500 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3ea5d95c-fc48-4996-b09c-d98a0ac93182 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:52.644952 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3ea5d95c-fc48-4996-b09c-d98a0ac93182 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:52.652378 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ea5d95c-fc48-4996-b09c-d98a0ac93182 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:52.652907 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ea5d95c-fc48-4996-b09c-d98a0ac93182 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:52.654141 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ea5d95c-fc48-4996-b09c-d98a0ac93182 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:52.654859 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ea5d95c-fc48-4996-b09c-d98a0ac93182 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:52.909280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3ea5d95c-fc48-4996-b09c-d98a0ac93182 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:52.920995 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3ea5d95c-fc48-4996-b09c-d98a0ac93182 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1319 microversion: 2.1 time: 0.281436 Apr 12 16:20:52.922195 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 148/302] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:52 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:53.076715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-29038ab9-522e-4c6a-93f8-4ae6bc652a5a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-761886994"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:53.077377 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-29038ab9-522e-4c6a-93f8-4ae6bc652a5a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:53.088003 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-29038ab9-522e-4c6a-93f8-4ae6bc652a5a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:53.088687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-29038ab9-522e-4c6a-93f8-4ae6bc652a5a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:53.089585 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-29038ab9-522e-4c6a-93f8-4ae6bc652a5a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:53.090171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-29038ab9-522e-4c6a-93f8-4ae6bc652a5a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:53.295701 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.network.security_group_api [None req-29038ab9-522e-4c6a-93f8-4ae6bc652a5a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Adding security group 6a2986f5-b1de-47c0-ace0-c1573b2644a1 to port 94c5c57b-adf1-460f-930c-36fd03392889 Apr 12 16:20:53.536483 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-919fa601-3709-41cc-8427-c18685efb587 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:53.537576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-919fa601-3709-41cc-8427-c18685efb587 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:53.543908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-919fa601-3709-41cc-8427-c18685efb587 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:53.543908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-919fa601-3709-41cc-8427-c18685efb587 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:53.544561 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-919fa601-3709-41cc-8427-c18685efb587 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:53.545193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-919fa601-3709-41cc-8427-c18685efb587 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:53.568918 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-919fa601-3709-41cc-8427-c18685efb587 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lazy-loading 'flavor' on Instance uuid f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:20:53.685405 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-919fa601-3709-41cc-8427-c18685efb587 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5/action" status: 200 len: 32 microversion: 2.1 time: 0.152766 Apr 12 16:20:53.686315 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 149/303] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:20:53 2022] POST /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 16:20:53.696823 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a960226e-58f6-4847-9235-f3e9fa77c671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:53.698012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a960226e-58f6-4847-9235-f3e9fa77c671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:53.708518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a960226e-58f6-4847-9235-f3e9fa77c671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:53.709585 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a960226e-58f6-4847-9235-f3e9fa77c671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:53.710779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a960226e-58f6-4847-9235-f3e9fa77c671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:53.711447 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a960226e-58f6-4847-9235-f3e9fa77c671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:54.185575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-29038ab9-522e-4c6a-93f8-4ae6bc652a5a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "POST /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/action" status: 202 len: 0 microversion: 2.1 time: 1.112868 Apr 12 16:20:54.186553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 155/304] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:20:53 2022] POST /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/action => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:20:54.191625 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-61a665a9-fb04-4b62-a567-93c12c193b05 req-6e100a6c-c232-4871-a774-f5b97e2a1570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ccc877e-8add-4637-87ca-3d598180f495", "tag": "964b26c8-87b2-4c98-a446-64b394850524"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:54.201044 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-61a665a9-fb04-4b62-a567-93c12c193b05 req-6e100a6c-c232-4871-a774-f5b97e2a1570 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:54.201486 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-61a665a9-fb04-4b62-a567-93c12c193b05 req-6e100a6c-c232-4871-a774-f5b97e2a1570 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:54.220957 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-61a665a9-fb04-4b62-a567-93c12c193b05 req-6e100a6c-c232-4871-a774-f5b97e2a1570 service nova] Creating event network-changed:964b26c8-87b2-4c98-a446-64b394850524 for instance 8ccc877e-8add-4637-87ca-3d598180f495 on hv-cinder-83752 Apr 12 16:20:54.228249 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-61a665a9-fb04-4b62-a567-93c12c193b05 req-6e100a6c-c232-4871-a774-f5b97e2a1570 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040409 Apr 12 16:20:54.232628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 156/305] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:54.238027 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e005652a-aa28-48c6-bae7-82a6f37bbea6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:54.238746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e005652a-aa28-48c6-bae7-82a6f37bbea6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:54.245622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e005652a-aa28-48c6-bae7-82a6f37bbea6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:54.246134 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e005652a-aa28-48c6-bae7-82a6f37bbea6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:54.246914 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e005652a-aa28-48c6-bae7-82a6f37bbea6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:54.247344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e005652a-aa28-48c6-bae7-82a6f37bbea6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:54.262471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a960226e-58f6-4847-9235-f3e9fa77c671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:54.280898 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a960226e-58f6-4847-9235-f3e9fa77c671 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.589388 Apr 12 16:20:54.284417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 150/306] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:53 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:20:54.300323 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1a702291-e7b9-48b5-8d81-21bd58569db6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:54.302726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1a702291-e7b9-48b5-8d81-21bd58569db6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:54.315258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a702291-e7b9-48b5-8d81-21bd58569db6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:54.316078 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a702291-e7b9-48b5-8d81-21bd58569db6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:54.317067 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a702291-e7b9-48b5-8d81-21bd58569db6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:54.317815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a702291-e7b9-48b5-8d81-21bd58569db6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:55.004121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1a702291-e7b9-48b5-8d81-21bd58569db6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:55.013742 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1a702291-e7b9-48b5-8d81-21bd58569db6 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1758 microversion: 2.1 time: 0.727149 Apr 12 16:20:55.014442 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 151/307] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:54 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1758 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:55.024760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e005652a-aa28-48c6-bae7-82a6f37bbea6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:55.032302 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e005652a-aa28-48c6-bae7-82a6f37bbea6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1319 microversion: 2.1 time: 0.798417 Apr 12 16:20:55.042471 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 157/308] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:54 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1319 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:55.303822 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e418ea3b-8df8-46d1-8931-55b2dcc8a11a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:55.304241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e418ea3b-8df8-46d1-8931-55b2dcc8a11a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:55.310250 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e418ea3b-8df8-46d1-8931-55b2dcc8a11a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:55.310697 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e418ea3b-8df8-46d1-8931-55b2dcc8a11a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:55.311471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e418ea3b-8df8-46d1-8931-55b2dcc8a11a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:55.312073 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e418ea3b-8df8-46d1-8931-55b2dcc8a11a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:55.475054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e418ea3b-8df8-46d1-8931-55b2dcc8a11a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:55.482971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e418ea3b-8df8-46d1-8931-55b2dcc8a11a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.184228 Apr 12 16:20:55.483620 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 152/309] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:55 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:56.051211 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-27760afc-4a90-43bd-b03a-b372dff4fa9a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:56.051995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-27760afc-4a90-43bd-b03a-b372dff4fa9a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:56.058303 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-27760afc-4a90-43bd-b03a-b372dff4fa9a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:56.058738 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-27760afc-4a90-43bd-b03a-b372dff4fa9a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:56.059520 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-27760afc-4a90-43bd-b03a-b372dff4fa9a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:56.059951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-27760afc-4a90-43bd-b03a-b372dff4fa9a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:56.193000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-27760afc-4a90-43bd-b03a-b372dff4fa9a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:56.200888 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-27760afc-4a90-43bd-b03a-b372dff4fa9a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1319 microversion: 2.1 time: 0.153197 Apr 12 16:20:56.201671 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 158/310] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:56 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:56.259436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-799eec8d-079b-4df4-b6d6-2063cd5d46f9 req-0211faf8-b784-47c0-92ee-90042f998b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74711e3a-cd18-4260-b9d1-7f393f377971", "tag": "94c5c57b-adf1-460f-930c-36fd03392889"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:56.268908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-799eec8d-079b-4df4-b6d6-2063cd5d46f9 req-0211faf8-b784-47c0-92ee-90042f998b7d service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:56.269529 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-799eec8d-079b-4df4-b6d6-2063cd5d46f9 req-0211faf8-b784-47c0-92ee-90042f998b7d service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:56.281882 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-799eec8d-079b-4df4-b6d6-2063cd5d46f9 req-0211faf8-b784-47c0-92ee-90042f998b7d service nova] Creating event network-changed:94c5c57b-adf1-460f-930c-36fd03392889 for instance 74711e3a-cd18-4260-b9d1-7f393f377971 on hv-cinder-83752 Apr 12 16:20:56.287006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-799eec8d-079b-4df4-b6d6-2063cd5d46f9 req-0211faf8-b784-47c0-92ee-90042f998b7d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Apr 12 16:20:56.287602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 153/311] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:56.501085 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-de1452a1-f9a5-475a-82ec-c86dde1532f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:56.501677 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-de1452a1-f9a5-475a-82ec-c86dde1532f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:56.507916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-de1452a1-f9a5-475a-82ec-c86dde1532f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:56.508373 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-de1452a1-f9a5-475a-82ec-c86dde1532f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:56.509157 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-de1452a1-f9a5-475a-82ec-c86dde1532f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:56.509589 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-de1452a1-f9a5-475a-82ec-c86dde1532f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:56.642076 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-de1452a1-f9a5-475a-82ec-c86dde1532f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:56.649512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-de1452a1-f9a5-475a-82ec-c86dde1532f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.152449 Apr 12 16:20:56.650107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 159/312] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:56 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:57.225878 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-286dac96-2752-4512-a151-ab33e55e9f7a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:57.227521 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-286dac96-2752-4512-a151-ab33e55e9f7a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:57.263029 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-286dac96-2752-4512-a151-ab33e55e9f7a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:57.265146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-286dac96-2752-4512-a151-ab33e55e9f7a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:57.266433 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-286dac96-2752-4512-a151-ab33e55e9f7a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:57.267012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-286dac96-2752-4512-a151-ab33e55e9f7a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:57.432104 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-286dac96-2752-4512-a151-ab33e55e9f7a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:57.439770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-286dac96-2752-4512-a151-ab33e55e9f7a tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1319 microversion: 2.1 time: 0.223958 Apr 12 16:20:57.440334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 154/313] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:57 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:57.667153 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4fde22b9-5400-46f8-b9ed-6c8383b27a87 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:57.667809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4fde22b9-5400-46f8-b9ed-6c8383b27a87 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:57.674530 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4fde22b9-5400-46f8-b9ed-6c8383b27a87 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:57.675003 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4fde22b9-5400-46f8-b9ed-6c8383b27a87 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:57.675833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4fde22b9-5400-46f8-b9ed-6c8383b27a87 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:57.676300 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4fde22b9-5400-46f8-b9ed-6c8383b27a87 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:57.938822 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4fde22b9-5400-46f8-b9ed-6c8383b27a87 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:57.946605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4fde22b9-5400-46f8-b9ed-6c8383b27a87 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.283317 Apr 12 16:20:57.956387 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 160/314] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:57 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:58.458932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-93cfa2d3-a6a5-43dc-9123-bb27b1d45f66 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:58.459537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-93cfa2d3-a6a5-43dc-9123-bb27b1d45f66 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:58.472631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-93cfa2d3-a6a5-43dc-9123-bb27b1d45f66 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:58.473075 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-93cfa2d3-a6a5-43dc-9123-bb27b1d45f66 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:58.473951 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-93cfa2d3-a6a5-43dc-9123-bb27b1d45f66 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:58.474402 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-93cfa2d3-a6a5-43dc-9123-bb27b1d45f66 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:58.621575 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-93cfa2d3-a6a5-43dc-9123-bb27b1d45f66 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:58.631560 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-93cfa2d3-a6a5-43dc-9123-bb27b1d45f66 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1319 microversion: 2.1 time: 0.178357 Apr 12 16:20:58.632244 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 155/315] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:58 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:58.964456 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c4b906aa-8fa1-41be-8ae9-f3455d9ab447 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:58.965066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c4b906aa-8fa1-41be-8ae9-f3455d9ab447 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:58.971963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4b906aa-8fa1-41be-8ae9-f3455d9ab447 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:58.972420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4b906aa-8fa1-41be-8ae9-f3455d9ab447 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:58.973182 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4b906aa-8fa1-41be-8ae9-f3455d9ab447 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:58.977970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4b906aa-8fa1-41be-8ae9-f3455d9ab447 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:59.133776 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c4b906aa-8fa1-41be-8ae9-f3455d9ab447 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:59.142263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c4b906aa-8fa1-41be-8ae9-f3455d9ab447 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.181498 Apr 12 16:20:59.143166 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 161/316] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:58 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:59.653407 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-95c814ac-8e76-412f-b090-9210da9a48e5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:59.654609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-95c814ac-8e76-412f-b090-9210da9a48e5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:20:59.663901 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-95c814ac-8e76-412f-b090-9210da9a48e5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:59.664355 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-95c814ac-8e76-412f-b090-9210da9a48e5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:59.665133 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-95c814ac-8e76-412f-b090-9210da9a48e5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:20:59.665562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-95c814ac-8e76-412f-b090-9210da9a48e5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:20:59.812417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-95c814ac-8e76-412f-b090-9210da9a48e5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:20:59.821792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-95c814ac-8e76-412f-b090-9210da9a48e5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1319 microversion: 2.1 time: 0.175161 Apr 12 16:20:59.822798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 156/317] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:20:59 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:00.163262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5dd43a2f-4744-4d52-a717-3fcfd0f859f5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:00.163925 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5dd43a2f-4744-4d52-a717-3fcfd0f859f5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:00.171489 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5dd43a2f-4744-4d52-a717-3fcfd0f859f5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:00.172186 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5dd43a2f-4744-4d52-a717-3fcfd0f859f5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:00.173036 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5dd43a2f-4744-4d52-a717-3fcfd0f859f5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:00.173470 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5dd43a2f-4744-4d52-a717-3fcfd0f859f5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:00.249215 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-59c2ef29-3012-4a55-a8fb-ca4c892db97c req-788d11b0-0e64-4627-b3a2-245eeb2c429c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccc877e-8add-4637-87ca-3d598180f495", "name": "network-vif-plugged", "status": "completed", "tag": "964b26c8-87b2-4c98-a446-64b394850524"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:00.259397 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-59c2ef29-3012-4a55-a8fb-ca4c892db97c req-788d11b0-0e64-4627-b3a2-245eeb2c429c service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:00.260532 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-59c2ef29-3012-4a55-a8fb-ca4c892db97c req-788d11b0-0e64-4627-b3a2-245eeb2c429c service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:00.274853 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-59c2ef29-3012-4a55-a8fb-ca4c892db97c req-788d11b0-0e64-4627-b3a2-245eeb2c429c service nova] Creating event network-vif-plugged:964b26c8-87b2-4c98-a446-64b394850524 for instance 8ccc877e-8add-4637-87ca-3d598180f495 on hv-cinder-83752 Apr 12 16:21:00.282848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-59c2ef29-3012-4a55-a8fb-ca4c892db97c req-788d11b0-0e64-4627-b3a2-245eeb2c429c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038204 Apr 12 16:21:00.284086 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 157/318] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:21:00.315957 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5dd43a2f-4744-4d52-a717-3fcfd0f859f5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:00.324310 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5dd43a2f-4744-4d52-a717-3fcfd0f859f5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.165336 Apr 12 16:21:00.326666 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 162/319] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:00 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:00.840532 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cbf2e5ed-2d7d-4675-aa57-563763d32621 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:00.841326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cbf2e5ed-2d7d-4675-aa57-563763d32621 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:00.848539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cbf2e5ed-2d7d-4675-aa57-563763d32621 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:00.848993 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cbf2e5ed-2d7d-4675-aa57-563763d32621 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:00.849901 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cbf2e5ed-2d7d-4675-aa57-563763d32621 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:00.850372 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cbf2e5ed-2d7d-4675-aa57-563763d32621 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:01.018845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cbf2e5ed-2d7d-4675-aa57-563763d32621 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:01.027478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cbf2e5ed-2d7d-4675-aa57-563763d32621 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1319 microversion: 2.1 time: 0.191071 Apr 12 16:21:01.032880 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 158/320] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:00 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:01.341032 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-dcfe7326-c1f2-47b0-9006-baa0c30c8fdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:01.341644 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-dcfe7326-c1f2-47b0-9006-baa0c30c8fdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:01.348238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dcfe7326-c1f2-47b0-9006-baa0c30c8fdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:01.348808 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dcfe7326-c1f2-47b0-9006-baa0c30c8fdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:01.349757 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dcfe7326-c1f2-47b0-9006-baa0c30c8fdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:01.350139 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dcfe7326-c1f2-47b0-9006-baa0c30c8fdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:01.531596 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dcfe7326-c1f2-47b0-9006-baa0c30c8fdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:01.539390 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-dcfe7326-c1f2-47b0-9006-baa0c30c8fdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.202235 Apr 12 16:21:01.539937 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 163/321] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:01 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:02.047260 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-538f0891-5049-43bd-baf7-380a3446393d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:02.048023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-538f0891-5049-43bd-baf7-380a3446393d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:02.055024 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-538f0891-5049-43bd-baf7-380a3446393d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:02.055475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-538f0891-5049-43bd-baf7-380a3446393d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:02.056259 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-538f0891-5049-43bd-baf7-380a3446393d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:02.056694 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-538f0891-5049-43bd-baf7-380a3446393d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:02.192478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-538f0891-5049-43bd-baf7-380a3446393d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:02.199697 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-538f0891-5049-43bd-baf7-380a3446393d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1319 microversion: 2.1 time: 0.156739 Apr 12 16:21:02.200262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 159/322] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:02 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:02.557185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7f0a145b-8cd1-41f6-95b4-36654c3ec9ab tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:02.559267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7f0a145b-8cd1-41f6-95b4-36654c3ec9ab tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:02.565361 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f0a145b-8cd1-41f6-95b4-36654c3ec9ab tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:02.565811 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f0a145b-8cd1-41f6-95b4-36654c3ec9ab tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:02.566641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f0a145b-8cd1-41f6-95b4-36654c3ec9ab tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:02.567140 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f0a145b-8cd1-41f6-95b4-36654c3ec9ab tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:02.682993 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1659637543", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-944614855", "security_groups": [{"name": "tempest-secgroup-smoke-93198052"}], "block_device_mapping_v2": [{"uuid": "63f0f36c-357e-48b8-9a35-351fd62499dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46b7a5ea-cc45-4b33-bcf1-fa2441d5a8b0"}]}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:02.717394 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-7f0a145b-8cd1-41f6-95b4-36654c3ec9ab tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:02.725247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7f0a145b-8cd1-41f6-95b4-36654c3ec9ab tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.172326 Apr 12 16:21:02.726501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 164/323] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:02 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:02.812969 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] validate_networks() for [('46b7a5ea-cc45-4b33-bcf1-fa2441d5a8b0', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:21:03.219260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-96a64642-563a-4833-a823-727a5fe03ac5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:03.220089 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-96a64642-563a-4833-a823-727a5fe03ac5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:03.229447 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-96a64642-563a-4833-a823-727a5fe03ac5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:03.229796 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-96a64642-563a-4833-a823-727a5fe03ac5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:03.231048 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-96a64642-563a-4833-a823-727a5fe03ac5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:03.231873 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-96a64642-563a-4833-a823-727a5fe03ac5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:03.482881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-96a64642-563a-4833-a823-727a5fe03ac5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:03.494398 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-96a64642-563a-4833-a823-727a5fe03ac5 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1506 microversion: 2.1 time: 0.280255 Apr 12 16:21:03.494963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 165/324] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:03 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:03.521379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-209f80e3-e468-4436-8873-953bbacfb6c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:03.521911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:21:03.522428 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-209f80e3-e468-4436-8873-953bbacfb6c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:03.522542 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:21:03.522822 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:21:03.523230 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:21:03.523654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:21:03.530584 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-209f80e3-e468-4436-8873-953bbacfb6c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:03.531455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-209f80e3-e468-4436-8873-953bbacfb6c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:03.532338 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-209f80e3-e468-4436-8873-953bbacfb6c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:03.532991 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-209f80e3-e468-4436-8873-953bbacfb6c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:03.534163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:03.534665 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:03.535460 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:03.536419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:03.554072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for project 9efdb664508148aab946b17b16013559. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:21:03.559003 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for user b72b05bd57f241128f065c0b94663f6d and project 9efdb664508148aab946b17b16013559. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:21:03.572541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-209f80e3-e468-4436-8873-953bbacfb6c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/ips" status: 200 len: 150 microversion: 2.1 time: 0.056369 Apr 12 16:21:03.576791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 166/325] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:21:03 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/ips => generated 150 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:03.623877 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:21:03.628433 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63f0f36c-357e-48b8-9a35-351fd62499dc',volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:21:03.743427 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1117c2f5-b1f5-4693-ad97-41668b26e0b1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:03.744039 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1117c2f5-b1f5-4693-ad97-41668b26e0b1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:03.750088 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1117c2f5-b1f5-4693-ad97-41668b26e0b1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:03.750755 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1117c2f5-b1f5-4693-ad97-41668b26e0b1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:03.751715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1117c2f5-b1f5-4693-ad97-41668b26e0b1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:03.752344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1117c2f5-b1f5-4693-ad97-41668b26e0b1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:03.923952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1117c2f5-b1f5-4693-ad97-41668b26e0b1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:03.933666 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1117c2f5-b1f5-4693-ad97-41668b26e0b1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.194843 Apr 12 16:21:03.934640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 167/326] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:03 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:04.147222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2f3f1825-0d0a-436e-aadb-74ad41d4f3d0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.468114 Apr 12 16:21:04.148626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 160/327] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:21:02 2022] POST /compute/v2.1/servers => generated 404 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 12 16:21:04.158540 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cd61dd88-4fa9-4f46-89ea-23ee35061c7a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:04.159383 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-cd61dd88-4fa9-4f46-89ea-23ee35061c7a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:04.229637 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-cd61dd88-4fa9-4f46-89ea-23ee35061c7a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:04.237050 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-cd61dd88-4fa9-4f46-89ea-23ee35061c7a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1094 microversion: 2.1 time: 0.082783 Apr 12 16:21:04.237972 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 168/328] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:04 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:04.953326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c3e98d92-e9b8-4f0b-8bd2-2a3fdefe4e1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:04.953975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c3e98d92-e9b8-4f0b-8bd2-2a3fdefe4e1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:04.961304 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3e98d92-e9b8-4f0b-8bd2-2a3fdefe4e1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:04.961874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3e98d92-e9b8-4f0b-8bd2-2a3fdefe4e1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:04.962763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3e98d92-e9b8-4f0b-8bd2-2a3fdefe4e1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:04.963238 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3e98d92-e9b8-4f0b-8bd2-2a3fdefe4e1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:05.088940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-68af5252-bd3f-403d-ad9d-fb6accdcf3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b212363a-b28e-4e98-95c3-c6fcda23dcbf"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:05.090120 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-68af5252-bd3f-403d-ad9d-fb6accdcf3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:05.098861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68af5252-bd3f-403d-ad9d-fb6accdcf3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:05.099088 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68af5252-bd3f-403d-ad9d-fb6accdcf3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:05.100063 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68af5252-bd3f-403d-ad9d-fb6accdcf3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:05.100827 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68af5252-bd3f-403d-ad9d-fb6accdcf3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:05.109603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c3e98d92-e9b8-4f0b-8bd2-2a3fdefe4e1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:05.120971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c3e98d92-e9b8-4f0b-8bd2-2a3fdefe4e1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.171454 Apr 12 16:21:05.122062 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 161/329] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:04 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:05.255103 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7c17c0ea-80e3-40ab-9dc0-037080a08283 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:05.255895 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7c17c0ea-80e3-40ab-9dc0-037080a08283 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:05.261960 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7c17c0ea-80e3-40ab-9dc0-037080a08283 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:05.262451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7c17c0ea-80e3-40ab-9dc0-037080a08283 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:05.263228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7c17c0ea-80e3-40ab-9dc0-037080a08283 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:05.263661 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7c17c0ea-80e3-40ab-9dc0-037080a08283 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:05.324650 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7c17c0ea-80e3-40ab-9dc0-037080a08283 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:05.332650 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7c17c0ea-80e3-40ab-9dc0-037080a08283 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1192 microversion: 2.1 time: 0.081572 Apr 12 16:21:05.333263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 162/330] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:05 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:05.618132 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-68af5252-bd3f-403d-ad9d-fb6accdcf3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528374 Apr 12 16:21:05.618421 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 169/331] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:21:05 2022] POST /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:06.142125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-10901377-ef44-4988-84ca-4baf09c11011 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:06.142754 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-10901377-ef44-4988-84ca-4baf09c11011 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:06.149857 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-10901377-ef44-4988-84ca-4baf09c11011 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:06.150239 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-10901377-ef44-4988-84ca-4baf09c11011 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:06.151018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-10901377-ef44-4988-84ca-4baf09c11011 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:06.151647 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-10901377-ef44-4988-84ca-4baf09c11011 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:06.349627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-10901377-ef44-4988-84ca-4baf09c11011 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:06.351133 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-531ac177-7b97-48cb-abe5-1b18b38c2c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:06.351858 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-531ac177-7b97-48cb-abe5-1b18b38c2c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:06.358482 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-10901377-ef44-4988-84ca-4baf09c11011 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.221781 Apr 12 16:21:06.359283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 163/332] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:06 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:06.359401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-531ac177-7b97-48cb-abe5-1b18b38c2c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:06.365099 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-531ac177-7b97-48cb-abe5-1b18b38c2c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:06.366022 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-531ac177-7b97-48cb-abe5-1b18b38c2c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:06.366500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-531ac177-7b97-48cb-abe5-1b18b38c2c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:06.580618 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-531ac177-7b97-48cb-abe5-1b18b38c2c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:06.589461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-531ac177-7b97-48cb-abe5-1b18b38c2c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1276 microversion: 2.1 time: 0.242755 Apr 12 16:21:06.590261 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 170/333] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:06 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:07.249127 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-769d79e3-0aee-43b0-956b-148ac433381d req-cefeb596-6728-4281-b711-b3a065228208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a439a34a-3d5a-48a4-8f9c-adbf98011c79", "tag": "deda406a-1751-4df5-995b-7f40d3fcb82e"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:07.263087 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-769d79e3-0aee-43b0-956b-148ac433381d req-cefeb596-6728-4281-b711-b3a065228208 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:07.263539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-769d79e3-0aee-43b0-956b-148ac433381d req-cefeb596-6728-4281-b711-b3a065228208 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:07.276200 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-769d79e3-0aee-43b0-956b-148ac433381d req-cefeb596-6728-4281-b711-b3a065228208 service nova] Creating event network-changed:deda406a-1751-4df5-995b-7f40d3fcb82e for instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 on hv-cinder-83752 Apr 12 16:21:07.281934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-769d79e3-0aee-43b0-956b-148ac433381d req-cefeb596-6728-4281-b711-b3a065228208 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036325 Apr 12 16:21:07.283156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 164/334] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:07.377933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2d922347-ebc3-4455-90ae-c01f5d2c5803 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:07.379274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2d922347-ebc3-4455-90ae-c01f5d2c5803 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:07.387035 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d922347-ebc3-4455-90ae-c01f5d2c5803 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:07.387760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d922347-ebc3-4455-90ae-c01f5d2c5803 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:07.388687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d922347-ebc3-4455-90ae-c01f5d2c5803 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:07.389279 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d922347-ebc3-4455-90ae-c01f5d2c5803 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:07.582939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2d922347-ebc3-4455-90ae-c01f5d2c5803 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:07.591077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2d922347-ebc3-4455-90ae-c01f5d2c5803 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.217795 Apr 12 16:21:07.591788 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 171/335] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:07 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:07.608179 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3f811f6f-1c2c-4044-904c-7532ca5b78b3 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:07.608888 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3f811f6f-1c2c-4044-904c-7532ca5b78b3 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:07.616059 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3f811f6f-1c2c-4044-904c-7532ca5b78b3 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:07.616506 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3f811f6f-1c2c-4044-904c-7532ca5b78b3 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:07.617716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3f811f6f-1c2c-4044-904c-7532ca5b78b3 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:07.618207 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3f811f6f-1c2c-4044-904c-7532ca5b78b3 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:07.833955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3f811f6f-1c2c-4044-904c-7532ca5b78b3 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:07.841484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3f811f6f-1c2c-4044-904c-7532ca5b78b3 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.237763 Apr 12 16:21:07.842324 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 165/336] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:07 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:08.608051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bb69b59d-a41d-4638-83ad-34bc384cada1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:08.608658 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bb69b59d-a41d-4638-83ad-34bc384cada1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:08.615774 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bb69b59d-a41d-4638-83ad-34bc384cada1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:08.616210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bb69b59d-a41d-4638-83ad-34bc384cada1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:08.616983 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bb69b59d-a41d-4638-83ad-34bc384cada1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:08.617412 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bb69b59d-a41d-4638-83ad-34bc384cada1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:08.820734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-bb69b59d-a41d-4638-83ad-34bc384cada1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:08.829571 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bb69b59d-a41d-4638-83ad-34bc384cada1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.225315 Apr 12 16:21:08.832060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 172/337] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:08 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:08.860730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a4f04d25-2efd-4516-946b-eb1a517e2ee8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:08.861997 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a4f04d25-2efd-4516-946b-eb1a517e2ee8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:08.872283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4f04d25-2efd-4516-946b-eb1a517e2ee8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:08.873238 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4f04d25-2efd-4516-946b-eb1a517e2ee8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:08.874247 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4f04d25-2efd-4516-946b-eb1a517e2ee8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:08.874926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4f04d25-2efd-4516-946b-eb1a517e2ee8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:09.099005 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a4f04d25-2efd-4516-946b-eb1a517e2ee8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:09.106764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a4f04d25-2efd-4516-946b-eb1a517e2ee8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.250949 Apr 12 16:21:09.114973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 166/338] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:08 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:09.348818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c023948e-779b-4726-b4ae-56a1389e5c69 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:09.349305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c023948e-779b-4726-b4ae-56a1389e5c69 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:09.355537 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c023948e-779b-4726-b4ae-56a1389e5c69 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:09.355984 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c023948e-779b-4726-b4ae-56a1389e5c69 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:09.356742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c023948e-779b-4726-b4ae-56a1389e5c69 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:09.357171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c023948e-779b-4726-b4ae-56a1389e5c69 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:09.379956 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c023948e-779b-4726-b4ae-56a1389e5c69 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/ips" status: 200 len: 145 microversion: 2.1 time: 0.036798 Apr 12 16:21:09.380565 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 173/339] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:21:09 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:09.850860 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-841684e0-f54a-4a8a-aa2e-e069dcf83379 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:09.851631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-841684e0-f54a-4a8a-aa2e-e069dcf83379 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:09.860689 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-841684e0-f54a-4a8a-aa2e-e069dcf83379 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:09.861313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-841684e0-f54a-4a8a-aa2e-e069dcf83379 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:09.862571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-841684e0-f54a-4a8a-aa2e-e069dcf83379 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:09.863207 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-841684e0-f54a-4a8a-aa2e-e069dcf83379 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:10.006545 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-841684e0-f54a-4a8a-aa2e-e069dcf83379 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:10.013989 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-841684e0-f54a-4a8a-aa2e-e069dcf83379 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.169791 Apr 12 16:21:10.014564 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 167/340] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:09 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:10.124425 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-69cf2868-e436-47f2-969f-685530f84613 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:10.125010 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-69cf2868-e436-47f2-969f-685530f84613 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:10.132555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-69cf2868-e436-47f2-969f-685530f84613 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:10.133002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-69cf2868-e436-47f2-969f-685530f84613 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:10.133776 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-69cf2868-e436-47f2-969f-685530f84613 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:10.134455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-69cf2868-e436-47f2-969f-685530f84613 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:10.272081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-69cf2868-e436-47f2-969f-685530f84613 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:10.280518 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-69cf2868-e436-47f2-969f-685530f84613 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.159973 Apr 12 16:21:10.281244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 174/341] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:10 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:11.031108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0bb2fdcc-f717-4994-b19e-612a2fd31443 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:11.031729 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0bb2fdcc-f717-4994-b19e-612a2fd31443 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:11.038657 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0bb2fdcc-f717-4994-b19e-612a2fd31443 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:11.039090 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0bb2fdcc-f717-4994-b19e-612a2fd31443 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:11.039851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0bb2fdcc-f717-4994-b19e-612a2fd31443 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:11.040283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0bb2fdcc-f717-4994-b19e-612a2fd31443 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:11.181549 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0bb2fdcc-f717-4994-b19e-612a2fd31443 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:11.189837 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0bb2fdcc-f717-4994-b19e-612a2fd31443 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.162543 Apr 12 16:21:11.190458 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 168/342] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:11 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:11.304051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a79bd599-7b1d-49d5-a89c-5f087e3db97e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:11.304779 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a79bd599-7b1d-49d5-a89c-5f087e3db97e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:11.311055 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a79bd599-7b1d-49d5-a89c-5f087e3db97e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:11.311507 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a79bd599-7b1d-49d5-a89c-5f087e3db97e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:11.312283 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a79bd599-7b1d-49d5-a89c-5f087e3db97e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:11.312717 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a79bd599-7b1d-49d5-a89c-5f087e3db97e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:11.449556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a79bd599-7b1d-49d5-a89c-5f087e3db97e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:11.459178 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a79bd599-7b1d-49d5-a89c-5f087e3db97e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.162004 Apr 12 16:21:11.459787 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 175/343] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:11 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:12.208309 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c6ad348a-4df6-42f4-b382-8445959b015d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:12.209172 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c6ad348a-4df6-42f4-b382-8445959b015d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:12.216132 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c6ad348a-4df6-42f4-b382-8445959b015d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:12.216671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c6ad348a-4df6-42f4-b382-8445959b015d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:12.217586 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c6ad348a-4df6-42f4-b382-8445959b015d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:12.218015 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c6ad348a-4df6-42f4-b382-8445959b015d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:12.378383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c6ad348a-4df6-42f4-b382-8445959b015d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:12.386439 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c6ad348a-4df6-42f4-b382-8445959b015d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.182719 Apr 12 16:21:12.387023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 169/344] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:12 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:12.477934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-633a83d6-9934-414a-b48f-896bf5872bd2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:12.479414 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-633a83d6-9934-414a-b48f-896bf5872bd2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:12.486703 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-633a83d6-9934-414a-b48f-896bf5872bd2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:12.487156 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-633a83d6-9934-414a-b48f-896bf5872bd2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:12.488306 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-633a83d6-9934-414a-b48f-896bf5872bd2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:12.488426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-633a83d6-9934-414a-b48f-896bf5872bd2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:12.617945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-633a83d6-9934-414a-b48f-896bf5872bd2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:12.625577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-633a83d6-9934-414a-b48f-896bf5872bd2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.152347 Apr 12 16:21:12.626193 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 176/345] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:12 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:13.404337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-820b1ae0-ee4e-48e7-bdb5-c9597f80e286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:13.404902 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-820b1ae0-ee4e-48e7-bdb5-c9597f80e286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:13.413212 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-820b1ae0-ee4e-48e7-bdb5-c9597f80e286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:13.413678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-820b1ae0-ee4e-48e7-bdb5-c9597f80e286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:13.414577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-820b1ae0-ee4e-48e7-bdb5-c9597f80e286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:13.415081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-820b1ae0-ee4e-48e7-bdb5-c9597f80e286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:13.560590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-820b1ae0-ee4e-48e7-bdb5-c9597f80e286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:13.568134 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-820b1ae0-ee4e-48e7-bdb5-c9597f80e286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.168848 Apr 12 16:21:13.568707 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 170/346] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:13 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:13.644455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-00dcd2ce-f69a-493b-9316-07360a9201fd tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:13.645229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-00dcd2ce-f69a-493b-9316-07360a9201fd tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:13.652290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-00dcd2ce-f69a-493b-9316-07360a9201fd tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:13.652739 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-00dcd2ce-f69a-493b-9316-07360a9201fd tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:13.653522 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-00dcd2ce-f69a-493b-9316-07360a9201fd tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:13.653947 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-00dcd2ce-f69a-493b-9316-07360a9201fd tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:13.785959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-00dcd2ce-f69a-493b-9316-07360a9201fd tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:13.795990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-00dcd2ce-f69a-493b-9316-07360a9201fd tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.155315 Apr 12 16:21:13.796611 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 177/347] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:13 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:14.586752 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f678f479-f0f4-44a3-b11a-f52cea28673a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:14.587720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f678f479-f0f4-44a3-b11a-f52cea28673a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:14.599145 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f678f479-f0f4-44a3-b11a-f52cea28673a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:14.603751 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f678f479-f0f4-44a3-b11a-f52cea28673a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:14.607113 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f678f479-f0f4-44a3-b11a-f52cea28673a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:14.607593 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f678f479-f0f4-44a3-b11a-f52cea28673a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:14.744036 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f678f479-f0f4-44a3-b11a-f52cea28673a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:14.752375 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f678f479-f0f4-44a3-b11a-f52cea28673a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.170344 Apr 12 16:21:14.752891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 171/348] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:14 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:14.814403 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d5993711-911a-44eb-95ba-244ff218c584 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:14.815124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d5993711-911a-44eb-95ba-244ff218c584 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:14.822338 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d5993711-911a-44eb-95ba-244ff218c584 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:14.822791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d5993711-911a-44eb-95ba-244ff218c584 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:14.823566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d5993711-911a-44eb-95ba-244ff218c584 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:14.824003 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d5993711-911a-44eb-95ba-244ff218c584 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:14.979320 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d5993711-911a-44eb-95ba-244ff218c584 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:14.988287 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d5993711-911a-44eb-95ba-244ff218c584 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.178788 Apr 12 16:21:14.988929 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 178/349] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:14 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:15.733287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-86c3dcad-4f91-47ec-9a34-4d3e8a52e7b4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1553ba8-c3f0-428c-8c3b-eeb90b64add3"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:15.734992 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-86c3dcad-4f91-47ec-9a34-4d3e8a52e7b4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:15.743200 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-86c3dcad-4f91-47ec-9a34-4d3e8a52e7b4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:15.743582 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-86c3dcad-4f91-47ec-9a34-4d3e8a52e7b4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:15.744343 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-86c3dcad-4f91-47ec-9a34-4d3e8a52e7b4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:15.744780 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-86c3dcad-4f91-47ec-9a34-4d3e8a52e7b4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:15.761638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1503315912", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:15.818170 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] validate_networks() for None {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:21:16.112714 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:21:16.113153 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:21:16.113713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:21:16.114403 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:21:16.114987 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:21:16.126204 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:16.126694 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:16.127476 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:16.127912 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:16.146833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Getting quotas for project 4224329892c14501a19cf44244ea0f54. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:21:16.151612 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Getting quotas for user 5385e0d499a6419fb1faea4af8783f20 and project 4224329892c14501a19cf44244ea0f54. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:21:16.164647 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:21:16.166899 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:21:16.212966 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0d372c99-eb60-4592-87b6-fc9a2b09d32c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455157 Apr 12 16:21:16.214199 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 179/350] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:21:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:21:16.219394 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a2042ba0-a3d8-4607-8bba-c6d058bbd912 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:16.220038 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a2042ba0-a3d8-4607-8bba-c6d058bbd912 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:16.227356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2042ba0-a3d8-4607-8bba-c6d058bbd912 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:16.227869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2042ba0-a3d8-4607-8bba-c6d058bbd912 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:16.228699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2042ba0-a3d8-4607-8bba-c6d058bbd912 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:16.229139 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2042ba0-a3d8-4607-8bba-c6d058bbd912 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:16.375860 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a2042ba0-a3d8-4607-8bba-c6d058bbd912 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:16.385367 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a2042ba0-a3d8-4607-8bba-c6d058bbd912 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.169979 Apr 12 16:21:16.402435 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 180/351] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:16 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:16.408927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1ea4b109-91e2-4eb0-8491-5a6bf8a8d39c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:16.409669 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1ea4b109-91e2-4eb0-8491-5a6bf8a8d39c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:16.417674 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ea4b109-91e2-4eb0-8491-5a6bf8a8d39c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:16.418465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ea4b109-91e2-4eb0-8491-5a6bf8a8d39c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:16.419482 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ea4b109-91e2-4eb0-8491-5a6bf8a8d39c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:16.421269 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ea4b109-91e2-4eb0-8491-5a6bf8a8d39c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:16.453198 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1ea4b109-91e2-4eb0-8491-5a6bf8a8d39c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/ips" status: 200 len: 152 microversion: 2.20 time: 0.049269 Apr 12 16:21:16.454527 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 181/352] 10.222.0.67 () {60 vars in 1288 bytes} [Tue Apr 12 16:21:16 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:21:16.463934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4266344f-8797-4dbc-a258-e66cf59b1d3e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:16.464717 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4266344f-8797-4dbc-a258-e66cf59b1d3e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:16.471406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4266344f-8797-4dbc-a258-e66cf59b1d3e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:16.471861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4266344f-8797-4dbc-a258-e66cf59b1d3e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:16.472844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4266344f-8797-4dbc-a258-e66cf59b1d3e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:16.473337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4266344f-8797-4dbc-a258-e66cf59b1d3e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:16.656255 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4266344f-8797-4dbc-a258-e66cf59b1d3e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:16.666183 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4266344f-8797-4dbc-a258-e66cf59b1d3e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.209904 Apr 12 16:21:16.667122 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 182/353] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:16 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:16.683444 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-53845007-e43f-4442-9ade-9544fc664555 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:16.684497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-53845007-e43f-4442-9ade-9544fc664555 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:16.724996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-86c3dcad-4f91-47ec-9a34-4d3e8a52e7b4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.997434 Apr 12 16:21:16.725957 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 172/354] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:21:15 2022] POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:16.758742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-53845007-e43f-4442-9ade-9544fc664555 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:16.766707 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-53845007-e43f-4442-9ade-9544fc664555 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1215 microversion: 2.1 time: 0.088831 Apr 12 16:21:16.767422 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 183/355] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:16 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:17.404341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-596971f7-465a-486e-a784-f74fb6b59655 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:17.405606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-596971f7-465a-486e-a784-f74fb6b59655 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:17.412212 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-596971f7-465a-486e-a784-f74fb6b59655 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:17.412668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-596971f7-465a-486e-a784-f74fb6b59655 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:17.413456 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-596971f7-465a-486e-a784-f74fb6b59655 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:17.413893 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-596971f7-465a-486e-a784-f74fb6b59655 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:17.433251 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5d63dc20-ba83-4b8e-bdfc-fc8b389bebbc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: .version_select at 0x7f246dc2d280>, body: {"keypair": {"name": "tempest-keypair-56275195"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:17.447835 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5d63dc20-ba83-4b8e-bdfc-fc8b389bebbc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:21:17.451650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5d63dc20-ba83-4b8e-bdfc-fc8b389bebbc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:21:17.550302 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-596971f7-465a-486e-a784-f74fb6b59655 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:17.558856 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-596971f7-465a-486e-a784-f74fb6b59655 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.158809 Apr 12 16:21:17.559423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 173/356] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:17 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:17.683308 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1ceb4fb6-d9f9-468a-988a-aa5c7c522dcb tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:17.684031 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1ceb4fb6-d9f9-468a-988a-aa5c7c522dcb tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:17.690615 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ceb4fb6-d9f9-468a-988a-aa5c7c522dcb tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:17.691057 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ceb4fb6-d9f9-468a-988a-aa5c7c522dcb tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:17.691819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ceb4fb6-d9f9-468a-988a-aa5c7c522dcb tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:17.692541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ceb4fb6-d9f9-468a-988a-aa5c7c522dcb tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:17.743872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5d63dc20-ba83-4b8e-bdfc-fc8b389bebbc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:21:17.747382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5d63dc20-ba83-4b8e-bdfc-fc8b389bebbc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:21:17.760204 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5d63dc20-ba83-4b8e-bdfc-fc8b389bebbc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.330820 Apr 12 16:21:17.760846 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 184/357] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:21:17 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:17.785421 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4766da49-b687-486e-a758-940982e0ae13 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:17.787368 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4766da49-b687-486e-a758-940982e0ae13 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:17.795870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4766da49-b687-486e-a758-940982e0ae13 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:17.796297 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4766da49-b687-486e-a758-940982e0ae13 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:17.797622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4766da49-b687-486e-a758-940982e0ae13 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:17.798191 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4766da49-b687-486e-a758-940982e0ae13 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:17.842503 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1ceb4fb6-d9f9-468a-988a-aa5c7c522dcb tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:17.853286 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1ceb4fb6-d9f9-468a-988a-aa5c7c522dcb tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.173456 Apr 12 16:21:17.855337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 174/358] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:17 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:17.900906 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4766da49-b687-486e-a758-940982e0ae13 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:17.908581 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4766da49-b687-486e-a758-940982e0ae13 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1267 microversion: 2.1 time: 0.128095 Apr 12 16:21:17.909163 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 185/359] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:17 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1267 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:18.580500 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ef200aed-1435-4100-bf75-2a94e6d93f57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:18.582558 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ef200aed-1435-4100-bf75-2a94e6d93f57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:18.591861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ef200aed-1435-4100-bf75-2a94e6d93f57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:18.592715 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ef200aed-1435-4100-bf75-2a94e6d93f57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:18.593664 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ef200aed-1435-4100-bf75-2a94e6d93f57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:18.594252 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ef200aed-1435-4100-bf75-2a94e6d93f57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:18.878261 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-511fdf00-6436-49a9-92fd-beda41dfcf1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:18.879531 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-511fdf00-6436-49a9-92fd-beda41dfcf1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:18.889342 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-511fdf00-6436-49a9-92fd-beda41dfcf1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:18.889781 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-511fdf00-6436-49a9-92fd-beda41dfcf1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:18.890600 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-511fdf00-6436-49a9-92fd-beda41dfcf1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:18.891031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-511fdf00-6436-49a9-92fd-beda41dfcf1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:18.939380 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ef200aed-1435-4100-bf75-2a94e6d93f57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:18.949190 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ef200aed-1435-4100-bf75-2a94e6d93f57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.373827 Apr 12 16:21:18.949775 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 175/360] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:18 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:18.958019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b21f5cdc-bd3d-4004-acfc-49f957aa892c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:18.963727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b21f5cdc-bd3d-4004-acfc-49f957aa892c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:18.981793 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b21f5cdc-bd3d-4004-acfc-49f957aa892c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:18.982375 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b21f5cdc-bd3d-4004-acfc-49f957aa892c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:18.983259 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b21f5cdc-bd3d-4004-acfc-49f957aa892c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:18.983771 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b21f5cdc-bd3d-4004-acfc-49f957aa892c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:19.076971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b21f5cdc-bd3d-4004-acfc-49f957aa892c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:19.114629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b21f5cdc-bd3d-4004-acfc-49f957aa892c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1273 microversion: 2.1 time: 0.159889 Apr 12 16:21:19.115293 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 176/361] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:18 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:19.190576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-321272562", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ecce0ebb-6f6d-41f3-91d1-6cb5caa3527a"}], "security_groups": [{"name": "tempest-securitygroup--1123922668"}], "key_name": "tempest-keypair-56275195", "user_data": "}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:19.199587 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-511fdf00-6436-49a9-92fd-beda41dfcf1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:19.209058 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-511fdf00-6436-49a9-92fd-beda41dfcf1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.334547 Apr 12 16:21:19.219308 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 186/362] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:18 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:19.276934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-fdb19528-c7e7-4f9f-b3ea-36e3a91669f3 req-10a0c590-0bd7-4d91-8833-7858d24fadbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439a34a-3d5a-48a4-8f9c-adbf98011c79", "name": "network-vif-plugged", "status": "completed", "tag": "deda406a-1751-4df5-995b-7f40d3fcb82e"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:19.285951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-fdb19528-c7e7-4f9f-b3ea-36e3a91669f3 req-10a0c590-0bd7-4d91-8833-7858d24fadbf service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:19.286719 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-fdb19528-c7e7-4f9f-b3ea-36e3a91669f3 req-10a0c590-0bd7-4d91-8833-7858d24fadbf service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:19.298582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-fdb19528-c7e7-4f9f-b3ea-36e3a91669f3 req-10a0c590-0bd7-4d91-8833-7858d24fadbf service nova] Creating event network-vif-plugged:deda406a-1751-4df5-995b-7f40d3fcb82e for instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 on hv-cinder-83752 Apr 12 16:21:19.305075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-fdb19528-c7e7-4f9f-b3ea-36e3a91669f3 req-10a0c590-0bd7-4d91-8833-7858d24fadbf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031845 Apr 12 16:21:19.305993 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 187/363] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:21:19.410780 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] validate_networks() for [('ecce0ebb-6f6d-41f3-91d1-6cb5caa3527a', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:21:19.967836 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f7ed6f3d-9e3f-48f9-bd53-c9a2706e5cf6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:19.968545 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f7ed6f3d-9e3f-48f9-bd53-c9a2706e5cf6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:19.975722 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f7ed6f3d-9e3f-48f9-bd53-c9a2706e5cf6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:19.976171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f7ed6f3d-9e3f-48f9-bd53-c9a2706e5cf6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:19.976963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f7ed6f3d-9e3f-48f9-bd53-c9a2706e5cf6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:19.977410 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f7ed6f3d-9e3f-48f9-bd53-c9a2706e5cf6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.128900 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:21:20.130185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:21:20.130998 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:21:20.131562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:21:20.132121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:21:20.143158 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.144010 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.144963 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.145606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.165218 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:21:20.169473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:21:20.181353 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:21:20.183838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:21:20.217697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f7ed6f3d-9e3f-48f9-bd53-c9a2706e5cf6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:20.230676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f7ed6f3d-9e3f-48f9-bd53-c9a2706e5cf6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.266733 Apr 12 16:21:20.231255 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 188/364] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:19 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:20.238477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ce2e6779-e94e-4c3f-9d36-5a7fca3df3fc tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:20.239467 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ce2e6779-e94e-4c3f-9d36-5a7fca3df3fc tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:20.245059 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3498b968-6079-4527-8a47-f0656622f35b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.061403 Apr 12 16:21:20.246150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ce2e6779-e94e-4c3f-9d36-5a7fca3df3fc tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.246854 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ce2e6779-e94e-4c3f-9d36-5a7fca3df3fc tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.247875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ce2e6779-e94e-4c3f-9d36-5a7fca3df3fc tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.248276 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ce2e6779-e94e-4c3f-9d36-5a7fca3df3fc tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.250655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 177/365] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:21:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:21:20.257117 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-32fc31ac-6917-4dc4-afd7-90c9e02386fc tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:20.258463 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-32fc31ac-6917-4dc4-afd7-90c9e02386fc tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:20.265257 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-32fc31ac-6917-4dc4-afd7-90c9e02386fc tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.266281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-32fc31ac-6917-4dc4-afd7-90c9e02386fc tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.267288 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-32fc31ac-6917-4dc4-afd7-90c9e02386fc tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.267955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-32fc31ac-6917-4dc4-afd7-90c9e02386fc tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.576985 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ce2e6779-e94e-4c3f-9d36-5a7fca3df3fc tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:20.581354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-32fc31ac-6917-4dc4-afd7-90c9e02386fc tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:20.589356 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-32fc31ac-6917-4dc4-afd7-90c9e02386fc tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.337128 Apr 12 16:21:20.591885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ce2e6779-e94e-4c3f-9d36-5a7fca3df3fc tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.358606 Apr 12 16:21:20.594446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 178/366] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:20 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:20.595755 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 189/367] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:20 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:20.605741 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a3f8599d-ea11-4738-9aa8-cc9c3a16de64 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:20.606382 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a3f8599d-ea11-4738-9aa8-cc9c3a16de64 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:20.608973 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-39d121f2-1dbb-49d0-8e37-6bec75cfaa18 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:20.610009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-39d121f2-1dbb-49d0-8e37-6bec75cfaa18 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:20.622433 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-39d121f2-1dbb-49d0-8e37-6bec75cfaa18 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.623238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-39d121f2-1dbb-49d0-8e37-6bec75cfaa18 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.624042 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-39d121f2-1dbb-49d0-8e37-6bec75cfaa18 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.624478 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-39d121f2-1dbb-49d0-8e37-6bec75cfaa18 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.671272 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-39d121f2-1dbb-49d0-8e37-6bec75cfaa18 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lazy-loading 'flavor' on Instance uuid 29f48c36-5e37-4640-b589-df261265d809 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:21:20.695798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a3f8599d-ea11-4738-9aa8-cc9c3a16de64 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:20.716787 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a3f8599d-ea11-4738-9aa8-cc9c3a16de64 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1239 microversion: 2.1 time: 0.121025 Apr 12 16:21:20.718468 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 179/368] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:20 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1239 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:20.808168 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-b9104fcd-209b-4f9a-b64d-9326cf42be12 req-852bb5e9-d47a-47f2-b22a-ef7f05f1412d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "090e2715-75f1-4078-8b05-6cf170656ea1", "tag": "29d06177-36fb-4f13-a08c-b1e48832bedd"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:20.816660 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b9104fcd-209b-4f9a-b64d-9326cf42be12 req-852bb5e9-d47a-47f2-b22a-ef7f05f1412d service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.817341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b9104fcd-209b-4f9a-b64d-9326cf42be12 req-852bb5e9-d47a-47f2-b22a-ef7f05f1412d service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.833054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-b9104fcd-209b-4f9a-b64d-9326cf42be12 req-852bb5e9-d47a-47f2-b22a-ef7f05f1412d service nova] Creating event network-changed:29d06177-36fb-4f13-a08c-b1e48832bedd for instance 090e2715-75f1-4078-8b05-6cf170656ea1 on hv-cinder-83752 Apr 12 16:21:20.838722 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-b9104fcd-209b-4f9a-b64d-9326cf42be12 req-852bb5e9-d47a-47f2-b22a-ef7f05f1412d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033827 Apr 12 16:21:20.839674 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 180/369] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:21:20.957088 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-39d121f2-1dbb-49d0-8e37-6bec75cfaa18 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/action" status: 202 len: 0 microversion: 2.20 time: 0.360108 Apr 12 16:21:20.957822 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 190/370] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Apr 12 16:21:20 2022] POST /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:21:20.967106 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:20.967805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:20.974693 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.975144 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:20.975925 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:20.976429 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.121128 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:21.129369 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:21.130945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:21.132148 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4f8f5469-4b2e-41f3-9013-bac9fcf8bf9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.169382 Apr 12 16:21:21.132713 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 181/371] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:20 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:21.249971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-026439ed-35d8-41d9-a209-9976f150e76f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:21.250698 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-026439ed-35d8-41d9-a209-9976f150e76f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:21.257507 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-026439ed-35d8-41d9-a209-9976f150e76f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:21.257963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-026439ed-35d8-41d9-a209-9976f150e76f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.258777 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-026439ed-35d8-41d9-a209-9976f150e76f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:21.259212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-026439ed-35d8-41d9-a209-9976f150e76f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.403711 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-026439ed-35d8-41d9-a209-9976f150e76f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:21.415141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-026439ed-35d8-41d9-a209-9976f150e76f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.170075 Apr 12 16:21:21.415742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 191/372] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:21 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:21.611485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c5a4faa4-56bd-4337-b25e-28c4a2af43e5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:21.612540 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c5a4faa4-56bd-4337-b25e-28c4a2af43e5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:21.617081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f2823e42-4788-4be9-9fea-befe8fa7a1b8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:21.617721 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f2823e42-4788-4be9-9fea-befe8fa7a1b8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:21.619508 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c5a4faa4-56bd-4337-b25e-28c4a2af43e5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:21.620182 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c5a4faa4-56bd-4337-b25e-28c4a2af43e5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.621018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c5a4faa4-56bd-4337-b25e-28c4a2af43e5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:21.621518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c5a4faa4-56bd-4337-b25e-28c4a2af43e5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.626200 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f2823e42-4788-4be9-9fea-befe8fa7a1b8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:21.633489 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f2823e42-4788-4be9-9fea-befe8fa7a1b8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.634475 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f2823e42-4788-4be9-9fea-befe8fa7a1b8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:21.634927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f2823e42-4788-4be9-9fea-befe8fa7a1b8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.867313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c5a4faa4-56bd-4337-b25e-28c4a2af43e5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:21.870720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f2823e42-4788-4be9-9fea-befe8fa7a1b8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:21.875253 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c5a4faa4-56bd-4337-b25e-28c4a2af43e5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.267834 Apr 12 16:21:21.875848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 182/373] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:21 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:21.879290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f2823e42-4788-4be9-9fea-befe8fa7a1b8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.269210 Apr 12 16:21:21.879843 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 192/374] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:21 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:21.880717 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-25ea0e0b-e8b7-49eb-b6b1-83c672e96b3a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:21.881315 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-25ea0e0b-e8b7-49eb-b6b1-83c672e96b3a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:21.887383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-25ea0e0b-e8b7-49eb-b6b1-83c672e96b3a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:21.887855 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-25ea0e0b-e8b7-49eb-b6b1-83c672e96b3a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.888654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-25ea0e0b-e8b7-49eb-b6b1-83c672e96b3a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:21.889122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-25ea0e0b-e8b7-49eb-b6b1-83c672e96b3a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:21.955840 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-25ea0e0b-e8b7-49eb-b6b1-83c672e96b3a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:21.964164 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-25ea0e0b-e8b7-49eb-b6b1-83c672e96b3a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1235 microversion: 2.1 time: 0.087138 Apr 12 16:21:21.964711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 183/375] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:21 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:22.151680 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:22.152289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:22.159132 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:22.159582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:22.160350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:22.160964 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:22.301502 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:22.309439 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:22.310974 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:22.312125 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3fc19df2-5ccd-457c-a0bb-d564968f7937 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.164506 Apr 12 16:21:22.312687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 193/376] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:22 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:22.432547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ff8ddd03-63fa-488d-9eeb-55c67daef6bf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:22.433151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ff8ddd03-63fa-488d-9eeb-55c67daef6bf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:22.439688 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff8ddd03-63fa-488d-9eeb-55c67daef6bf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:22.440136 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff8ddd03-63fa-488d-9eeb-55c67daef6bf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:22.440910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff8ddd03-63fa-488d-9eeb-55c67daef6bf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:22.441347 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff8ddd03-63fa-488d-9eeb-55c67daef6bf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:22.577757 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ff8ddd03-63fa-488d-9eeb-55c67daef6bf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:22.586229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ff8ddd03-63fa-488d-9eeb-55c67daef6bf tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.157651 Apr 12 16:21:22.586832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 184/377] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:22 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:22.894976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-08a7b546-b972-4275-b14c-72ba836faed9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:22.895886 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-08a7b546-b972-4275-b14c-72ba836faed9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:22.897086 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8c6d1c46-95e0-4f6b-bafc-205b96a8aa42 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:22.897842 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8c6d1c46-95e0-4f6b-bafc-205b96a8aa42 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:22.903463 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-08a7b546-b972-4275-b14c-72ba836faed9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:22.904248 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-08a7b546-b972-4275-b14c-72ba836faed9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:22.905301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-08a7b546-b972-4275-b14c-72ba836faed9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:22.905871 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-08a7b546-b972-4275-b14c-72ba836faed9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:22.906231 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c6d1c46-95e0-4f6b-bafc-205b96a8aa42 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:22.906782 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c6d1c46-95e0-4f6b-bafc-205b96a8aa42 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:22.907640 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c6d1c46-95e0-4f6b-bafc-205b96a8aa42 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:22.908209 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c6d1c46-95e0-4f6b-bafc-205b96a8aa42 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:23.143637 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-08a7b546-b972-4275-b14c-72ba836faed9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:23.147952 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8c6d1c46-95e0-4f6b-bafc-205b96a8aa42 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:23.154084 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-08a7b546-b972-4275-b14c-72ba836faed9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1264 microversion: 2.1 time: 0.264956 Apr 12 16:21:23.160171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 194/378] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:22 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:23.160171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-80292ab6-f97f-4991-9051-caaa4352a18c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:23.160171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-80292ab6-f97f-4991-9051-caaa4352a18c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:23.164599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8c6d1c46-95e0-4f6b-bafc-205b96a8aa42 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.272469 Apr 12 16:21:23.165350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 185/379] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:22 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:23.167126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-80292ab6-f97f-4991-9051-caaa4352a18c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:23.167559 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-80292ab6-f97f-4991-9051-caaa4352a18c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:23.168799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-80292ab6-f97f-4991-9051-caaa4352a18c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:23.169593 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-80292ab6-f97f-4991-9051-caaa4352a18c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:23.234793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-80292ab6-f97f-4991-9051-caaa4352a18c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:23.242709 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-80292ab6-f97f-4991-9051-caaa4352a18c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1235 microversion: 2.1 time: 0.087101 Apr 12 16:21:23.243311 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 195/380] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:23 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:23.332424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:23.333552 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:23.339792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:23.340239 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:23.341009 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:23.341438 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:23.494634 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:23.504116 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:23.507135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:23.508583 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-73ecd9a8-ef37-4f47-9b82-409e0b323835 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.180535 Apr 12 16:21:23.509407 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 186/381] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:23 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:23.607292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e7ada03d-54db-4efb-8db7-b8254d7fb484 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:23.607952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e7ada03d-54db-4efb-8db7-b8254d7fb484 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:23.618705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e7ada03d-54db-4efb-8db7-b8254d7fb484 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:23.619364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e7ada03d-54db-4efb-8db7-b8254d7fb484 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:23.620543 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e7ada03d-54db-4efb-8db7-b8254d7fb484 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:23.621163 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e7ada03d-54db-4efb-8db7-b8254d7fb484 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:23.764815 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e7ada03d-54db-4efb-8db7-b8254d7fb484 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:23.776088 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e7ada03d-54db-4efb-8db7-b8254d7fb484 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.174949 Apr 12 16:21:23.776959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 196/382] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:23 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:24.171349 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f179517b-296a-4f8c-befe-78075675cc08 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:24.171919 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f179517b-296a-4f8c-befe-78075675cc08 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:24.179379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f179517b-296a-4f8c-befe-78075675cc08 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.179833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f179517b-296a-4f8c-befe-78075675cc08 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.180613 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f179517b-296a-4f8c-befe-78075675cc08 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.181044 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f179517b-296a-4f8c-befe-78075675cc08 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.184330 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6bda54b8-27cd-4c16-940b-a552b02cbb99 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:24.185071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6bda54b8-27cd-4c16-940b-a552b02cbb99 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:24.191154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6bda54b8-27cd-4c16-940b-a552b02cbb99 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.191599 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6bda54b8-27cd-4c16-940b-a552b02cbb99 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.192364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6bda54b8-27cd-4c16-940b-a552b02cbb99 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.192963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6bda54b8-27cd-4c16-940b-a552b02cbb99 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.380758 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f179517b-296a-4f8c-befe-78075675cc08 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:24.388328 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6bda54b8-27cd-4c16-940b-a552b02cbb99 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:24.390073 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f179517b-296a-4f8c-befe-78075675cc08 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1451 microversion: 2.1 time: 0.222424 Apr 12 16:21:24.391127 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 187/383] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:24 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1451 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:24.396496 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6bda54b8-27cd-4c16-940b-a552b02cbb99 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.217672 Apr 12 16:21:24.397423 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 197/384] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:24 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:24.399768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-041709bc-dce4-4205-9df2-99c06db3c1fb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:24.400665 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-041709bc-dce4-4205-9df2-99c06db3c1fb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:24.406739 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-041709bc-dce4-4205-9df2-99c06db3c1fb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.407190 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-041709bc-dce4-4205-9df2-99c06db3c1fb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.407965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-041709bc-dce4-4205-9df2-99c06db3c1fb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.408398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-041709bc-dce4-4205-9df2-99c06db3c1fb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.415785 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a1d37890-3f28-4f2e-a76a-f5062f0a514c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:24.416391 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a1d37890-3f28-4f2e-a76a-f5062f0a514c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:24.422111 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a1d37890-3f28-4f2e-a76a-f5062f0a514c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.422562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a1d37890-3f28-4f2e-a76a-f5062f0a514c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.423322 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a1d37890-3f28-4f2e-a76a-f5062f0a514c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.423749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a1d37890-3f28-4f2e-a76a-f5062f0a514c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.476860 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-041709bc-dce4-4205-9df2-99c06db3c1fb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:24.484308 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-041709bc-dce4-4205-9df2-99c06db3c1fb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1235 microversion: 2.1 time: 0.091823 Apr 12 16:21:24.484887 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 188/385] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:24 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1235 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:24.532721 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:24.533498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:24.539798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.540243 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.541165 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.541404 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.570876 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a1d37890-3f28-4f2e-a76a-f5062f0a514c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:24.579028 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a1d37890-3f28-4f2e-a76a-f5062f0a514c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1451 microversion: 2.1 time: 0.167187 Apr 12 16:21:24.579577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 198/386] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:24 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:24.674724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:24.683932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:24.685806 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:24.687378 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0bc0c5e2-d52f-490a-893d-8a086e698a20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.158524 Apr 12 16:21:24.688299 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 189/387] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:24 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:21:24.796630 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bd8e6804-1ae2-4ea4-98bf-d53a6270bcf9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:24.797208 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bd8e6804-1ae2-4ea4-98bf-d53a6270bcf9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:24.803936 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bd8e6804-1ae2-4ea4-98bf-d53a6270bcf9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.804391 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bd8e6804-1ae2-4ea4-98bf-d53a6270bcf9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.805446 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bd8e6804-1ae2-4ea4-98bf-d53a6270bcf9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:24.805884 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bd8e6804-1ae2-4ea4-98bf-d53a6270bcf9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:24.938860 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-bd8e6804-1ae2-4ea4-98bf-d53a6270bcf9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:24.946495 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bd8e6804-1ae2-4ea4-98bf-d53a6270bcf9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.153659 Apr 12 16:21:24.947073 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 199/388] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:24 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:25.424419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ad588b2b-2fa8-4655-b4b3-6e9f588f3d78 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:25.432768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ad588b2b-2fa8-4655-b4b3-6e9f588f3d78 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:25.437776 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ad588b2b-2fa8-4655-b4b3-6e9f588f3d78 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:25.438444 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ad588b2b-2fa8-4655-b4b3-6e9f588f3d78 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:25.439873 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ad588b2b-2fa8-4655-b4b3-6e9f588f3d78 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:25.440550 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ad588b2b-2fa8-4655-b4b3-6e9f588f3d78 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:25.517035 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-af2df0a8-8145-4dda-a7ed-6fda4e121051 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:25.519288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-af2df0a8-8145-4dda-a7ed-6fda4e121051 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:25.530407 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af2df0a8-8145-4dda-a7ed-6fda4e121051 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:25.535753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af2df0a8-8145-4dda-a7ed-6fda4e121051 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:25.538922 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af2df0a8-8145-4dda-a7ed-6fda4e121051 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:25.542459 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af2df0a8-8145-4dda-a7ed-6fda4e121051 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:25.641025 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-af2df0a8-8145-4dda-a7ed-6fda4e121051 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:25.649960 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-af2df0a8-8145-4dda-a7ed-6fda4e121051 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1291 microversion: 2.1 time: 0.150207 Apr 12 16:21:25.660156 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 200/389] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:25 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1291 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:25.672536 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ad588b2b-2fa8-4655-b4b3-6e9f588f3d78 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:25.680249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ad588b2b-2fa8-4655-b4b3-6e9f588f3d78 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.265077 Apr 12 16:21:25.680954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 190/390] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:25 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:25.708153 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:25.708911 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:25.715503 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:25.715986 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:25.716775 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:25.717202 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:25.846026 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:25.854754 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:25.856307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:25.857471 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8c563ae2-2a13-4b28-8445-f9483f917c49 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.154732 Apr 12 16:21:25.858032 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 201/391] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:25 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:25.963417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-552eee62-066e-43a9-9468-a69dac1509a9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:25.964179 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-552eee62-066e-43a9-9468-a69dac1509a9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:25.970653 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-552eee62-066e-43a9-9468-a69dac1509a9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:25.971267 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-552eee62-066e-43a9-9468-a69dac1509a9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:25.972059 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-552eee62-066e-43a9-9468-a69dac1509a9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:25.972487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-552eee62-066e-43a9-9468-a69dac1509a9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:26.112239 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-552eee62-066e-43a9-9468-a69dac1509a9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:26.119961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-552eee62-066e-43a9-9468-a69dac1509a9 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.160519 Apr 12 16:21:26.120535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 191/392] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:25 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:26.519530 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-a676a02c-d101-42c9-857e-435e3708987d req-73a46e7f-a07f-444f-b1f1-4c773ca26b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a439a34a-3d5a-48a4-8f9c-adbf98011c79", "tag": "deda406a-1751-4df5-995b-7f40d3fcb82e"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:26.533401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-a676a02c-d101-42c9-857e-435e3708987d req-73a46e7f-a07f-444f-b1f1-4c773ca26b6f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:26.533847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-a676a02c-d101-42c9-857e-435e3708987d req-73a46e7f-a07f-444f-b1f1-4c773ca26b6f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:26.550516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-212dd4c4-89ea-4fb8-a3f3-4fea7a2d1146 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:26.555633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-a676a02c-d101-42c9-857e-435e3708987d req-73a46e7f-a07f-444f-b1f1-4c773ca26b6f service nova] Creating event network-changed:deda406a-1751-4df5-995b-7f40d3fcb82e for instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 on hv-cinder-83752 Apr 12 16:21:26.558756 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-212dd4c4-89ea-4fb8-a3f3-4fea7a2d1146 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:26.559428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-212dd4c4-89ea-4fb8-a3f3-4fea7a2d1146 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:26.562127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-a676a02c-d101-42c9-857e-435e3708987d req-73a46e7f-a07f-444f-b1f1-4c773ca26b6f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047063 Apr 12 16:21:26.563057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 202/393] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:26.633006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-212dd4c4-89ea-4fb8-a3f3-4fea7a2d1146 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Going to try to stop instance {{(pid=117202) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 12 16:21:26.672212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d34166e4-8b3f-4399-8199-ead79157c25a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:26.672985 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d34166e4-8b3f-4399-8199-ead79157c25a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:26.681520 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d34166e4-8b3f-4399-8199-ead79157c25a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:26.681980 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d34166e4-8b3f-4399-8199-ead79157c25a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:26.683295 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d34166e4-8b3f-4399-8199-ead79157c25a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:26.686478 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d34166e4-8b3f-4399-8199-ead79157c25a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:26.699812 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-212dd4c4-89ea-4fb8-a3f3-4fea7a2d1146 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/action" status: 202 len: 0 microversion: 2.1 time: 0.152204 Apr 12 16:21:26.701998 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 192/394] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:21:26 2022] POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:21:26.722658 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5b9dba2d-b5b2-474a-a459-bbf3ed46042d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:26.723796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5b9dba2d-b5b2-474a-a459-bbf3ed46042d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:26.733865 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5b9dba2d-b5b2-474a-a459-bbf3ed46042d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:26.734352 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5b9dba2d-b5b2-474a-a459-bbf3ed46042d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:26.735320 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5b9dba2d-b5b2-474a-a459-bbf3ed46042d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:26.735751 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5b9dba2d-b5b2-474a-a459-bbf3ed46042d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:26.890620 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d34166e4-8b3f-4399-8199-ead79157c25a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:26.900851 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d34166e4-8b3f-4399-8199-ead79157c25a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1291 microversion: 2.1 time: 0.234974 Apr 12 16:21:26.902230 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 203/395] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:26 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1291 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:26.908509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3705c862-8ef6-433c-9d2e-2c8bc28ef10d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:26.909407 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3705c862-8ef6-433c-9d2e-2c8bc28ef10d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:26.917936 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3705c862-8ef6-433c-9d2e-2c8bc28ef10d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:26.917936 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3705c862-8ef6-433c-9d2e-2c8bc28ef10d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:26.919483 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3705c862-8ef6-433c-9d2e-2c8bc28ef10d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:26.920014 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3705c862-8ef6-433c-9d2e-2c8bc28ef10d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:27.330598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5b9dba2d-b5b2-474a-a459-bbf3ed46042d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:27.338841 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5b9dba2d-b5b2-474a-a459-bbf3ed46042d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.635347 Apr 12 16:21:27.339765 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 193/396] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:26 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:27.344975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:27.345606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:27.354839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:27.355294 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:27.356100 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:27.356574 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:27.412603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3705c862-8ef6-433c-9d2e-2c8bc28ef10d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:27.422746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3705c862-8ef6-433c-9d2e-2c8bc28ef10d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.518938 Apr 12 16:21:27.423633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 204/397] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:26 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:27.428334 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-41c7e588-6c3c-45c8-a521-83ae3c0ad672 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:27.429017 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-41c7e588-6c3c-45c8-a521-83ae3c0ad672 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:27.435219 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-41c7e588-6c3c-45c8-a521-83ae3c0ad672 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:27.435999 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-41c7e588-6c3c-45c8-a521-83ae3c0ad672 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:27.436622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-41c7e588-6c3c-45c8-a521-83ae3c0ad672 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:27.437137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-41c7e588-6c3c-45c8-a521-83ae3c0ad672 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:27.567732 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:27.577516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:27.579356 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:27.580932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c3bd2e80-cc48-435e-adf3-356e1ed6474e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.240077 Apr 12 16:21:27.581690 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 194/398] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:27 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:27.643722 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-41c7e588-6c3c-45c8-a521-83ae3c0ad672 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:27.651441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-41c7e588-6c3c-45c8-a521-83ae3c0ad672 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.226468 Apr 12 16:21:27.662256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 205/399] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:27 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:27.918131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-fa4fe447-4324-456e-9c14-8d4ae7a59860 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:27.918703 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-fa4fe447-4324-456e-9c14-8d4ae7a59860 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:27.925270 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fa4fe447-4324-456e-9c14-8d4ae7a59860 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:27.925711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fa4fe447-4324-456e-9c14-8d4ae7a59860 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:27.926602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fa4fe447-4324-456e-9c14-8d4ae7a59860 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:27.927115 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fa4fe447-4324-456e-9c14-8d4ae7a59860 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:27.993009 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-fa4fe447-4324-456e-9c14-8d4ae7a59860 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:28.005000 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-fa4fe447-4324-456e-9c14-8d4ae7a59860 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1299 microversion: 2.1 time: 0.090495 Apr 12 16:21:28.005802 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 195/400] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:27 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:28.360924 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ff3c4d62-aa4c-42e9-b10a-9b0a02c2c752 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:28.361926 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ff3c4d62-aa4c-42e9-b10a-9b0a02c2c752 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:28.372818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff3c4d62-aa4c-42e9-b10a-9b0a02c2c752 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:28.373564 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff3c4d62-aa4c-42e9-b10a-9b0a02c2c752 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:28.374869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff3c4d62-aa4c-42e9-b10a-9b0a02c2c752 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:28.375572 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff3c4d62-aa4c-42e9-b10a-9b0a02c2c752 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:28.440822 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-170780f4-74fd-4340-8310-3b5dfed49ce5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:28.441467 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-170780f4-74fd-4340-8310-3b5dfed49ce5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:28.448669 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-170780f4-74fd-4340-8310-3b5dfed49ce5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:28.449163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-170780f4-74fd-4340-8310-3b5dfed49ce5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:28.450007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-170780f4-74fd-4340-8310-3b5dfed49ce5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:28.450542 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-170780f4-74fd-4340-8310-3b5dfed49ce5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:28.539026 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ff3c4d62-aa4c-42e9-b10a-9b0a02c2c752 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:28.546392 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ff3c4d62-aa4c-42e9-b10a-9b0a02c2c752 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.191876 Apr 12 16:21:28.547286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 206/401] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:28 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:28.601016 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:28.601723 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-170780f4-74fd-4340-8310-3b5dfed49ce5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:28.601863 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:28.608944 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:28.609399 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:28.610129 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-170780f4-74fd-4340-8310-3b5dfed49ce5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.173589 Apr 12 16:21:28.610268 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:28.610673 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:28.611141 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 196/402] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:28 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:28.668696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7d951760-199c-4b92-8372-fc91f0e498be tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:28.669491 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7d951760-199c-4b92-8372-fc91f0e498be tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:28.675870 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d951760-199c-4b92-8372-fc91f0e498be tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:28.676654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d951760-199c-4b92-8372-fc91f0e498be tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:28.677695 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d951760-199c-4b92-8372-fc91f0e498be tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:28.678357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d951760-199c-4b92-8372-fc91f0e498be tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:28.778780 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:28.787809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:28.789297 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:28.790523 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-265adcc8-4a49-4f84-9e01-46685e544c6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.193604 Apr 12 16:21:28.791075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 207/403] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:28 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:28.827971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7d951760-199c-4b92-8372-fc91f0e498be tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:28.836474 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7d951760-199c-4b92-8372-fc91f0e498be tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.171715 Apr 12 16:21:28.837089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 197/404] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:28 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:29.027581 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9fd91186-5bf4-48e7-9f0f-7181bc73d8f8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:29.028316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9fd91186-5bf4-48e7-9f0f-7181bc73d8f8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:29.035021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9fd91186-5bf4-48e7-9f0f-7181bc73d8f8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.035573 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9fd91186-5bf4-48e7-9f0f-7181bc73d8f8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.036421 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9fd91186-5bf4-48e7-9f0f-7181bc73d8f8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.036807 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9fd91186-5bf4-48e7-9f0f-7181bc73d8f8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.100330 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9fd91186-5bf4-48e7-9f0f-7181bc73d8f8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:29.108321 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9fd91186-5bf4-48e7-9f0f-7181bc73d8f8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1299 microversion: 2.1 time: 0.084687 Apr 12 16:21:29.108933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 208/405] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:29 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:29.564108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3e4c61fe-9c50-45cd-bbb5-6e532df8b8f3 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:29.564833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3e4c61fe-9c50-45cd-bbb5-6e532df8b8f3 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:29.571940 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3e4c61fe-9c50-45cd-bbb5-6e532df8b8f3 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.572395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3e4c61fe-9c50-45cd-bbb5-6e532df8b8f3 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.573168 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3e4c61fe-9c50-45cd-bbb5-6e532df8b8f3 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.573606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3e4c61fe-9c50-45cd-bbb5-6e532df8b8f3 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.628127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a5d291a4-20d4-4ad3-b801-a36058ddf404 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:29.628823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a5d291a4-20d4-4ad3-b801-a36058ddf404 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:29.642172 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a5d291a4-20d4-4ad3-b801-a36058ddf404 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.642626 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a5d291a4-20d4-4ad3-b801-a36058ddf404 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.643399 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a5d291a4-20d4-4ad3-b801-a36058ddf404 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.643856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a5d291a4-20d4-4ad3-b801-a36058ddf404 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.754463 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3e4c61fe-9c50-45cd-bbb5-6e532df8b8f3 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:29.762464 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3e4c61fe-9c50-45cd-bbb5-6e532df8b8f3 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.202621 Apr 12 16:21:29.763071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 198/406] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:29 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:29.799950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a5d291a4-20d4-4ad3-b801-a36058ddf404 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:29.808707 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:29.809089 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a5d291a4-20d4-4ad3-b801-a36058ddf404 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.184798 Apr 12 16:21:29.809345 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:29.809675 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 209/407] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:29 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:29.815563 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.815962 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.816790 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.817231 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.858271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-fc6366b0-3f5a-427c-814b-83f27f2eba44 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:29.859085 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-fc6366b0-3f5a-427c-814b-83f27f2eba44 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:29.865093 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fc6366b0-3f5a-427c-814b-83f27f2eba44 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.865570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fc6366b0-3f5a-427c-814b-83f27f2eba44 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.866370 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fc6366b0-3f5a-427c-814b-83f27f2eba44 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:29.866808 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fc6366b0-3f5a-427c-814b-83f27f2eba44 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:29.997352 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:30.005471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:30.006934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:30.008101 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-66f351cb-ab87-4a09-ae79-c947aac50e6f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.203252 Apr 12 16:21:30.008686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 199/408] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:29 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:30.023864 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-fc6366b0-3f5a-427c-814b-83f27f2eba44 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:30.031939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-fc6366b0-3f5a-427c-814b-83f27f2eba44 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.177201 Apr 12 16:21:30.032480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 210/409] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:29 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:30.128459 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a13bf609-911e-4662-b00a-a044de915652 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:30.128981 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a13bf609-911e-4662-b00a-a044de915652 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:30.136210 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a13bf609-911e-4662-b00a-a044de915652 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:30.136642 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a13bf609-911e-4662-b00a-a044de915652 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:30.137450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a13bf609-911e-4662-b00a-a044de915652 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:30.137882 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a13bf609-911e-4662-b00a-a044de915652 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:30.209948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a13bf609-911e-4662-b00a-a044de915652 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:30.218246 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a13bf609-911e-4662-b00a-a044de915652 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1299 microversion: 2.1 time: 0.093729 Apr 12 16:21:30.218803 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 200/410] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:30 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:30.778745 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6785073e-4410-400b-bf9a-cdea24626bd2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:30.779365 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6785073e-4410-400b-bf9a-cdea24626bd2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:30.789083 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6785073e-4410-400b-bf9a-cdea24626bd2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:30.789546 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6785073e-4410-400b-bf9a-cdea24626bd2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:30.790353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6785073e-4410-400b-bf9a-cdea24626bd2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:30.790994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6785073e-4410-400b-bf9a-cdea24626bd2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:30.827072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1ae4e918-47f7-41ec-b785-e27d83c50cf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:30.827851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1ae4e918-47f7-41ec-b785-e27d83c50cf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:30.835256 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ae4e918-47f7-41ec-b785-e27d83c50cf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:30.835712 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ae4e918-47f7-41ec-b785-e27d83c50cf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:30.836488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ae4e918-47f7-41ec-b785-e27d83c50cf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:30.836928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ae4e918-47f7-41ec-b785-e27d83c50cf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:31.098629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1ae4e918-47f7-41ec-b785-e27d83c50cf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:31.101206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6785073e-4410-400b-bf9a-cdea24626bd2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:31.108943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1ae4e918-47f7-41ec-b785-e27d83c50cf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.285741 Apr 12 16:21:31.119124 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 201/411] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:30 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:31.119124 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:31.119410 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6785073e-4410-400b-bf9a-cdea24626bd2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.340935 Apr 12 16:21:31.119535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:31.123046 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:31.123709 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:31.124689 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:31.125427 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:31.131018 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 211/412] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:30 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:31.138844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ed48221b-6f05-4f80-97fc-bdd0ec00c639 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:31.139521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ed48221b-6f05-4f80-97fc-bdd0ec00c639 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:31.147794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ed48221b-6f05-4f80-97fc-bdd0ec00c639 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:31.148575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ed48221b-6f05-4f80-97fc-bdd0ec00c639 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:31.150562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ed48221b-6f05-4f80-97fc-bdd0ec00c639 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:31.151225 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ed48221b-6f05-4f80-97fc-bdd0ec00c639 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:31.401301 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:31.409897 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:31.411713 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:31.412961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-74f47ab8-8c02-4e73-8f4a-1fb0e8c6c6d0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.301450 Apr 12 16:21:31.413602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 202/413] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:31 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:31.418098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4bd37681-0a89-4537-bb04-ff22d442b132 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:31.418705 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4bd37681-0a89-4537-bb04-ff22d442b132 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:31.424824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4bd37681-0a89-4537-bb04-ff22d442b132 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:31.425485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4bd37681-0a89-4537-bb04-ff22d442b132 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:31.426328 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4bd37681-0a89-4537-bb04-ff22d442b132 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:31.426767 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4bd37681-0a89-4537-bb04-ff22d442b132 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:31.446064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ed48221b-6f05-4f80-97fc-bdd0ec00c639 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:31.454781 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ed48221b-6f05-4f80-97fc-bdd0ec00c639 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.322365 Apr 12 16:21:31.461904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 212/414] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:31 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:31.526458 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4bd37681-0a89-4537-bb04-ff22d442b132 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:31.537436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4bd37681-0a89-4537-bb04-ff22d442b132 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1297 microversion: 2.1 time: 0.122499 Apr 12 16:21:31.538342 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 203/415] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:31 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1297 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:32.126734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5adcca9b-3ef6-4311-b0d0-14c86270ce9f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:32.127467 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5adcca9b-3ef6-4311-b0d0-14c86270ce9f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:32.132654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5adbaf20-43db-4000-91e9-2f7ff46699c5 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:32.133279 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5adbaf20-43db-4000-91e9-2f7ff46699c5 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:32.134825 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5adcca9b-3ef6-4311-b0d0-14c86270ce9f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.135186 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5adcca9b-3ef6-4311-b0d0-14c86270ce9f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.135971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5adcca9b-3ef6-4311-b0d0-14c86270ce9f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.136401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5adcca9b-3ef6-4311-b0d0-14c86270ce9f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.139906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5adbaf20-43db-4000-91e9-2f7ff46699c5 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.140364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5adbaf20-43db-4000-91e9-2f7ff46699c5 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.141117 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5adbaf20-43db-4000-91e9-2f7ff46699c5 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.141580 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5adbaf20-43db-4000-91e9-2f7ff46699c5 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.359022 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5adbaf20-43db-4000-91e9-2f7ff46699c5 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:32.365829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5adcca9b-3ef6-4311-b0d0-14c86270ce9f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:32.366789 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5adbaf20-43db-4000-91e9-2f7ff46699c5 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.238123 Apr 12 16:21:32.367696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 204/416] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:32 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:32.375242 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5adcca9b-3ef6-4311-b0d0-14c86270ce9f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.252321 Apr 12 16:21:32.375942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 213/417] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:32 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:32.433488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:32.434424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:32.442748 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.443206 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.443967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.444400 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.473500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-da03641f-edd9-454f-b159-f058f8fe4d2a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:32.474142 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-da03641f-edd9-454f-b159-f058f8fe4d2a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:32.483383 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da03641f-edd9-454f-b159-f058f8fe4d2a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.484107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da03641f-edd9-454f-b159-f058f8fe4d2a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.485419 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da03641f-edd9-454f-b159-f058f8fe4d2a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.486154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da03641f-edd9-454f-b159-f058f8fe4d2a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.637092 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:32.646516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:32.648269 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:32.649427 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-aadbfc10-52b8-450e-aa17-afa1875ed5ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.221280 Apr 12 16:21:32.650325 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 205/418] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:32 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:32.654603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7b8e7699-97fa-45ce-86df-7bd59b3d27d0 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:32.655132 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7b8e7699-97fa-45ce-86df-7bd59b3d27d0 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:32.662765 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b8e7699-97fa-45ce-86df-7bd59b3d27d0 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.663210 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b8e7699-97fa-45ce-86df-7bd59b3d27d0 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.663985 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b8e7699-97fa-45ce-86df-7bd59b3d27d0 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:32.664413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b8e7699-97fa-45ce-86df-7bd59b3d27d0 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:32.669621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-da03641f-edd9-454f-b159-f058f8fe4d2a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:32.678606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-da03641f-edd9-454f-b159-f058f8fe4d2a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.209423 Apr 12 16:21:32.679743 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 214/419] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:32 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:32.818283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7b8e7699-97fa-45ce-86df-7bd59b3d27d0 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:32.827056 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7b8e7699-97fa-45ce-86df-7bd59b3d27d0 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.175946 Apr 12 16:21:32.828071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 206/420] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:32 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:33.389552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c9ae8d77-796d-43b7-9d12-3dbb26bbb893 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:33.390294 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c9ae8d77-796d-43b7-9d12-3dbb26bbb893 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:33.396823 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d976809d-4ddf-4ac6-bc75-8da37578585f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:33.397724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d976809d-4ddf-4ac6-bc75-8da37578585f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:33.400606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c9ae8d77-796d-43b7-9d12-3dbb26bbb893 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:33.401247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c9ae8d77-796d-43b7-9d12-3dbb26bbb893 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:33.402450 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c9ae8d77-796d-43b7-9d12-3dbb26bbb893 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:33.403180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c9ae8d77-796d-43b7-9d12-3dbb26bbb893 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:33.408143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d976809d-4ddf-4ac6-bc75-8da37578585f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:33.408817 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d976809d-4ddf-4ac6-bc75-8da37578585f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:33.409649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d976809d-4ddf-4ac6-bc75-8da37578585f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:33.410142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d976809d-4ddf-4ac6-bc75-8da37578585f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:33.596639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c9ae8d77-796d-43b7-9d12-3dbb26bbb893 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:33.599697 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d976809d-4ddf-4ac6-bc75-8da37578585f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:33.604833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c9ae8d77-796d-43b7-9d12-3dbb26bbb893 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.221582 Apr 12 16:21:33.605384 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 215/421] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:33 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:33.607702 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d976809d-4ddf-4ac6-bc75-8da37578585f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.217250 Apr 12 16:21:33.608302 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 207/422] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:33 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:33.669699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:33.670455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:33.680281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:33.680955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:33.682102 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:33.682723 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:33.696532 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-588a4a28-0021-4826-923f-8a85177db4ea tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:33.697287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-588a4a28-0021-4826-923f-8a85177db4ea tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:33.703732 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-588a4a28-0021-4826-923f-8a85177db4ea tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:33.704176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-588a4a28-0021-4826-923f-8a85177db4ea tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:33.704943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-588a4a28-0021-4826-923f-8a85177db4ea tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:33.705694 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-588a4a28-0021-4826-923f-8a85177db4ea tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:33.985185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:33.990401 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-588a4a28-0021-4826-923f-8a85177db4ea tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:33.993716 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:33.995251 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:33.996374 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e13f300e-35c5-4b24-8ee3-be56e078e083 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.332703 Apr 12 16:21:33.997244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 216/423] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:33 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:34.001659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-46ea5159-97d1-47ab-8ffa-15ed751ed211 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:34.002288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-46ea5159-97d1-47ab-8ffa-15ed751ed211 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:34.008511 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-46ea5159-97d1-47ab-8ffa-15ed751ed211 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:34.008958 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-46ea5159-97d1-47ab-8ffa-15ed751ed211 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:34.009536 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-588a4a28-0021-4826-923f-8a85177db4ea tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.316932 Apr 12 16:21:34.009711 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-46ea5159-97d1-47ab-8ffa-15ed751ed211 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:34.010358 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 208/424] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:33 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:34.010475 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-46ea5159-97d1-47ab-8ffa-15ed751ed211 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:34.303271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-46ea5159-97d1-47ab-8ffa-15ed751ed211 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:34.311188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-46ea5159-97d1-47ab-8ffa-15ed751ed211 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.312899 Apr 12 16:21:34.312102 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 217/425] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:33 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:34.484161 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-aeb7a96f-9a53-4115-bfe4-aa9f6a67316e req-324c844f-e7f8-4101-a1f1-ac2ea7d06cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090e2715-75f1-4078-8b05-6cf170656ea1", "name": "network-vif-plugged", "status": "completed", "tag": "29d06177-36fb-4f13-a08c-b1e48832bedd"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:34.497265 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-aeb7a96f-9a53-4115-bfe4-aa9f6a67316e req-324c844f-e7f8-4101-a1f1-ac2ea7d06cc5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:34.498711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-aeb7a96f-9a53-4115-bfe4-aa9f6a67316e req-324c844f-e7f8-4101-a1f1-ac2ea7d06cc5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:34.512952 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-aeb7a96f-9a53-4115-bfe4-aa9f6a67316e req-324c844f-e7f8-4101-a1f1-ac2ea7d06cc5 service nova] Creating event network-vif-plugged:29d06177-36fb-4f13-a08c-b1e48832bedd for instance 090e2715-75f1-4078-8b05-6cf170656ea1 on hv-cinder-83752 Apr 12 16:21:34.521647 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-aeb7a96f-9a53-4115-bfe4-aa9f6a67316e req-324c844f-e7f8-4101-a1f1-ac2ea7d06cc5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040680 Apr 12 16:21:34.523635 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 209/426] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:34.623411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-79639179-eaf7-4bd2-bf00-0f6b08685add tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:34.624662 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-79639179-eaf7-4bd2-bf00-0f6b08685add tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:34.626638 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-02689837-431c-426e-9dbf-92ca5fdb7ca1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:34.627409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-02689837-431c-426e-9dbf-92ca5fdb7ca1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:34.633888 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-79639179-eaf7-4bd2-bf00-0f6b08685add tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:34.635092 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-79639179-eaf7-4bd2-bf00-0f6b08685add tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:34.635304 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-02689837-431c-426e-9dbf-92ca5fdb7ca1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:34.635772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-02689837-431c-426e-9dbf-92ca5fdb7ca1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:34.636554 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-02689837-431c-426e-9dbf-92ca5fdb7ca1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:34.636792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-79639179-eaf7-4bd2-bf00-0f6b08685add tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:34.636988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-02689837-431c-426e-9dbf-92ca5fdb7ca1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:34.637735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-79639179-eaf7-4bd2-bf00-0f6b08685add tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:35.262676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-79639179-eaf7-4bd2-bf00-0f6b08685add tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:35.266074 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-02689837-431c-426e-9dbf-92ca5fdb7ca1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:35.270628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-79639179-eaf7-4bd2-bf00-0f6b08685add tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.651525 Apr 12 16:21:35.271196 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 218/427] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:34 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:35.274419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-02689837-431c-426e-9dbf-92ca5fdb7ca1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.653368 Apr 12 16:21:35.284500 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 210/428] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:34 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:35.284694 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-85248ab8-bca5-4f3f-9b63-5aece351e394 req-01e2b82c-5854-419d-9253-4fa6e727f0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06dc15d1-6e23-4515-9016-40ecb0211696", "tag": "f49f49e8-9e2c-413a-9e10-638937a3802d"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:35.284826 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:35.284826 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:35.285010 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-85248ab8-bca5-4f3f-9b63-5aece351e394 req-01e2b82c-5854-419d-9253-4fa6e727f0e7 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:35.285010 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-85248ab8-bca5-4f3f-9b63-5aece351e394 req-01e2b82c-5854-419d-9253-4fa6e727f0e7 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:35.286897 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:35.287347 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:35.288161 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:35.288588 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:35.295035 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-85248ab8-bca5-4f3f-9b63-5aece351e394 req-01e2b82c-5854-419d-9253-4fa6e727f0e7 service nova] Creating event network-changed:f49f49e8-9e2c-413a-9e10-638937a3802d for instance 06dc15d1-6e23-4515-9016-40ecb0211696 on hv-cinder-83752 Apr 12 16:21:35.300369 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-85248ab8-bca5-4f3f-9b63-5aece351e394 req-01e2b82c-5854-419d-9253-4fa6e727f0e7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028072 Apr 12 16:21:35.301137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 219/429] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:35.306230 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-06543aad-ce6b-4738-8cf4-bd5f142d52d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:35.306963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-06543aad-ce6b-4738-8cf4-bd5f142d52d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:35.312841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-06543aad-ce6b-4738-8cf4-bd5f142d52d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:35.313286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-06543aad-ce6b-4738-8cf4-bd5f142d52d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:35.314070 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-06543aad-ce6b-4738-8cf4-bd5f142d52d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:35.314509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-06543aad-ce6b-4738-8cf4-bd5f142d52d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:35.491004 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:35.498298 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-06543aad-ce6b-4738-8cf4-bd5f142d52d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:35.500387 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:35.501966 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:35.503240 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-00cbe7d2-e0fe-42b0-ade3-7f9c0f2f97c1 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.227337 Apr 12 16:21:35.503862 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 211/430] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:35 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:35.508744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-60738626-8c2a-439d-98e9-edeae182ac1d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:35.509346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-60738626-8c2a-439d-98e9-edeae182ac1d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:35.512375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-06543aad-ce6b-4738-8cf4-bd5f142d52d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.210100 Apr 12 16:21:35.513169 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 220/431] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:35 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:35.516432 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-60738626-8c2a-439d-98e9-edeae182ac1d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:35.517512 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-60738626-8c2a-439d-98e9-edeae182ac1d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:35.518707 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-60738626-8c2a-439d-98e9-edeae182ac1d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:35.519241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-60738626-8c2a-439d-98e9-edeae182ac1d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:35.710928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-60738626-8c2a-439d-98e9-edeae182ac1d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:35.721060 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-60738626-8c2a-439d-98e9-edeae182ac1d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.215659 Apr 12 16:21:35.721847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 212/432] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:35 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:36.290560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-68f7527f-0571-4242-bb0c-a02e7d88cba8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:36.291639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-68f7527f-0571-4242-bb0c-a02e7d88cba8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:36.294078 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-08e7b566-ccbc-4480-8723-62d3f7c21c8c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:36.294984 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-08e7b566-ccbc-4480-8723-62d3f7c21c8c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:36.300872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68f7527f-0571-4242-bb0c-a02e7d88cba8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.301934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68f7527f-0571-4242-bb0c-a02e7d88cba8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.302712 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68f7527f-0571-4242-bb0c-a02e7d88cba8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.303151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-68f7527f-0571-4242-bb0c-a02e7d88cba8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.303259 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08e7b566-ccbc-4480-8723-62d3f7c21c8c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.303596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08e7b566-ccbc-4480-8723-62d3f7c21c8c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.304361 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08e7b566-ccbc-4480-8723-62d3f7c21c8c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.304788 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08e7b566-ccbc-4480-8723-62d3f7c21c8c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.575513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-68f7527f-0571-4242-bb0c-a02e7d88cba8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:36.578836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-08e7b566-ccbc-4480-8723-62d3f7c21c8c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:36.583856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-68f7527f-0571-4242-bb0c-a02e7d88cba8 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.299315 Apr 12 16:21:36.584426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 221/433] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:36 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:36.588636 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-08e7b566-ccbc-4480-8723-62d3f7c21c8c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.299810 Apr 12 16:21:36.594566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 213/434] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:36 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:36.594726 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:36.594726 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:36.596567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.597112 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.598152 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.598312 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-48e0e52c-3469-42de-bd10-8252678bafe4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:36.598750 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.599193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-48e0e52c-3469-42de-bd10-8252678bafe4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:36.605267 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-48e0e52c-3469-42de-bd10-8252678bafe4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.606138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-48e0e52c-3469-42de-bd10-8252678bafe4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.606914 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-48e0e52c-3469-42de-bd10-8252678bafe4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.607347 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-48e0e52c-3469-42de-bd10-8252678bafe4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.794143 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:36.796868 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-48e0e52c-3469-42de-bd10-8252678bafe4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:36.803006 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:36.804442 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:36.805567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5db6cdc2-103e-4f98-b612-872b9c9f3e1d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.220165 Apr 12 16:21:36.805757 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-48e0e52c-3469-42de-bd10-8252678bafe4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1499 microversion: 2.1 time: 0.215601 Apr 12 16:21:36.817173 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 222/435] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:36 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:36.817392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 214/436] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:36 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1499 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:36.823168 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8dcd84d9-4558-48eb-94c0-8a51f18f42b9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:36.823488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddd744df-50a6-4338-94f3-5050fec05e97"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:36.823778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8dcd84d9-4558-48eb-94c0-8a51f18f42b9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:36.824639 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:36.829949 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8dcd84d9-4558-48eb-94c0-8a51f18f42b9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.830762 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8dcd84d9-4558-48eb-94c0-8a51f18f42b9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.830929 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.831380 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.831517 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8dcd84d9-4558-48eb-94c0-8a51f18f42b9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.831946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8dcd84d9-4558-48eb-94c0-8a51f18f42b9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.832244 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.832677 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.855094 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] HTTP exception thrown: Cannot 'attach_volume' instance f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 while it is in vm_state rescued Apr 12 16:21:36.855687 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Returning 409 to user: Cannot 'attach_volume' instance f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 while it is in vm_state rescued {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:21:36.856520 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-96521edb-b33f-4f2c-9a97-ed8ac43d5fa6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037087 Apr 12 16:21:36.857072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 215/437] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:21:36 2022] POST /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5/os-volume_attachments => generated 152 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 16:21:36.865387 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-949e09e0-2e7c-49db-94b5-daffcc7abf40 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:36.865910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-949e09e0-2e7c-49db-94b5-daffcc7abf40 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:36.872098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-949e09e0-2e7c-49db-94b5-daffcc7abf40 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.872548 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-949e09e0-2e7c-49db-94b5-daffcc7abf40 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.873288 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-949e09e0-2e7c-49db-94b5-daffcc7abf40 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.873720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-949e09e0-2e7c-49db-94b5-daffcc7abf40 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.943461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-949e09e0-2e7c-49db-94b5-daffcc7abf40 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5/action" status: 202 len: 0 microversion: 2.1 time: 0.081469 Apr 12 16:21:36.947088 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 216/438] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:21:36 2022] POST /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:21:36.952347 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3897493b-d17e-4016-8572-96fb5a0c023d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:36.953035 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3897493b-d17e-4016-8572-96fb5a0c023d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:36.959844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3897493b-d17e-4016-8572-96fb5a0c023d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.960282 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3897493b-d17e-4016-8572-96fb5a0c023d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.961110 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3897493b-d17e-4016-8572-96fb5a0c023d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:36.961546 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3897493b-d17e-4016-8572-96fb5a0c023d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:36.966744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8dcd84d9-4558-48eb-94c0-8a51f18f42b9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:36.974872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8dcd84d9-4558-48eb-94c0-8a51f18f42b9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.155469 Apr 12 16:21:36.975567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 223/439] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:36 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:37.052949 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f18dcc50-2279-4516-8793-16c3ca5a153e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0645c88-d0eb-4cfe-8f84-3a757fedf232", "device": "/dev/sdb"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:37.054687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f18dcc50-2279-4516-8793-16c3ca5a153e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:37.060552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f18dcc50-2279-4516-8793-16c3ca5a153e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:37.061007 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f18dcc50-2279-4516-8793-16c3ca5a153e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:37.061817 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f18dcc50-2279-4516-8793-16c3ca5a153e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:37.062279 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f18dcc50-2279-4516-8793-16c3ca5a153e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:37.092502 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3897493b-d17e-4016-8572-96fb5a0c023d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:37.100699 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3897493b-d17e-4016-8572-96fb5a0c023d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.152265 Apr 12 16:21:37.101582 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 217/440] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:36 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:37.600535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a50dd2cb-8e9c-416c-82c2-c64d46d9064a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:37.601218 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a50dd2cb-8e9c-416c-82c2-c64d46d9064a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:37.607565 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a50dd2cb-8e9c-416c-82c2-c64d46d9064a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:37.608012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a50dd2cb-8e9c-416c-82c2-c64d46d9064a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:37.608769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a50dd2cb-8e9c-416c-82c2-c64d46d9064a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:37.609198 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a50dd2cb-8e9c-416c-82c2-c64d46d9064a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:37.754712 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a50dd2cb-8e9c-416c-82c2-c64d46d9064a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:37.765825 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a50dd2cb-8e9c-416c-82c2-c64d46d9064a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.169214 Apr 12 16:21:37.766672 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 218/441] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:37 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:37.772322 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6fd536a8-f36a-40c9-8760-f2f6cc95643d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:37.772912 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6fd536a8-f36a-40c9-8760-f2f6cc95643d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:37.778516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6fd536a8-f36a-40c9-8760-f2f6cc95643d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:37.778959 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6fd536a8-f36a-40c9-8760-f2f6cc95643d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:37.779715 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6fd536a8-f36a-40c9-8760-f2f6cc95643d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:37.780144 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6fd536a8-f36a-40c9-8760-f2f6cc95643d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:37.915586 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6fd536a8-f36a-40c9-8760-f2f6cc95643d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:37.926627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6fd536a8-f36a-40c9-8760-f2f6cc95643d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.158796 Apr 12 16:21:37.927204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 219/442] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:37 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:37.933471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:37.934488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:37.943258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:37.943728 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:37.944551 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:37.944978 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:38.071885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:38.079664 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:38.081487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:38.082638 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dca9ae7f-83cf-4068-8bf3-8ae88d19d303 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.154545 Apr 12 16:21:38.083217 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 220/443] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:37 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:38.087792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d9899f7c-ad26-4005-add7-0357f0557a0a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:38.088387 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d9899f7c-ad26-4005-add7-0357f0557a0a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:38.094405 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9899f7c-ad26-4005-add7-0357f0557a0a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:38.094842 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9899f7c-ad26-4005-add7-0357f0557a0a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:38.095595 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9899f7c-ad26-4005-add7-0357f0557a0a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:38.096023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9899f7c-ad26-4005-add7-0357f0557a0a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:38.235945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d9899f7c-ad26-4005-add7-0357f0557a0a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:38.243857 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d9899f7c-ad26-4005-add7-0357f0557a0a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.159653 Apr 12 16:21:38.244462 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 221/444] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:38 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:38.248956 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cc40da35-9779-46e2-a2ad-d94bc7fcba84 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:38.249546 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cc40da35-9779-46e2-a2ad-d94bc7fcba84 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:38.255392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc40da35-9779-46e2-a2ad-d94bc7fcba84 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:38.255838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc40da35-9779-46e2-a2ad-d94bc7fcba84 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:38.256590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc40da35-9779-46e2-a2ad-d94bc7fcba84 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:38.257019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc40da35-9779-46e2-a2ad-d94bc7fcba84 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:38.383942 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cc40da35-9779-46e2-a2ad-d94bc7fcba84 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:38.391409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cc40da35-9779-46e2-a2ad-d94bc7fcba84 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.145933 Apr 12 16:21:38.392344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 222/445] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:38 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:38.787252 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-68375ffd-050a-4b05-ae6a-2e2fdd3d8e74 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:38.787903 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-68375ffd-050a-4b05-ae6a-2e2fdd3d8e74 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:38.794563 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68375ffd-050a-4b05-ae6a-2e2fdd3d8e74 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:38.795000 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68375ffd-050a-4b05-ae6a-2e2fdd3d8e74 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:38.795761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68375ffd-050a-4b05-ae6a-2e2fdd3d8e74 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:38.796186 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68375ffd-050a-4b05-ae6a-2e2fdd3d8e74 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:38.932919 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-68375ffd-050a-4b05-ae6a-2e2fdd3d8e74 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:38.940791 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-68375ffd-050a-4b05-ae6a-2e2fdd3d8e74 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.159659 Apr 12 16:21:38.941663 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 223/446] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:38 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:38.948400 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-03e2928c-8875-4cb5-90f2-0f400a3bbfce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:38.948996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-03e2928c-8875-4cb5-90f2-0f400a3bbfce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:38.954839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03e2928c-8875-4cb5-90f2-0f400a3bbfce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:38.955602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03e2928c-8875-4cb5-90f2-0f400a3bbfce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:38.956355 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03e2928c-8875-4cb5-90f2-0f400a3bbfce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:38.956784 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03e2928c-8875-4cb5-90f2-0f400a3bbfce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:39.089258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-03e2928c-8875-4cb5-90f2-0f400a3bbfce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:39.101709 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-03e2928c-8875-4cb5-90f2-0f400a3bbfce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.156605 Apr 12 16:21:39.102667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 224/447] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:38 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:39.108125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:39.108799 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:39.115205 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:39.115696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:39.116488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:39.116967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:39.261678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:39.271651 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:39.273518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:39.274711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3c71381a-a1d2-4a5f-8bfe-929641ce17ea tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.170943 Apr 12 16:21:39.275270 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 225/448] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:39 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:39.279769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4334d1f9-72e5-4115-ad46-84a52d1adb0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:39.280377 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4334d1f9-72e5-4115-ad46-84a52d1adb0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:39.286860 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4334d1f9-72e5-4115-ad46-84a52d1adb0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:39.287307 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4334d1f9-72e5-4115-ad46-84a52d1adb0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:39.288074 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4334d1f9-72e5-4115-ad46-84a52d1adb0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:39.288569 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4334d1f9-72e5-4115-ad46-84a52d1adb0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:39.434910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4334d1f9-72e5-4115-ad46-84a52d1adb0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:39.442907 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4334d1f9-72e5-4115-ad46-84a52d1adb0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.166689 Apr 12 16:21:39.443478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 226/449] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:39 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:39.447976 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b25381d9-ea8d-4004-9f0a-5634b64ed2e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:39.448606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b25381d9-ea8d-4004-9f0a-5634b64ed2e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:39.454610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b25381d9-ea8d-4004-9f0a-5634b64ed2e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:39.455066 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b25381d9-ea8d-4004-9f0a-5634b64ed2e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:39.456162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b25381d9-ea8d-4004-9f0a-5634b64ed2e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:39.456597 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b25381d9-ea8d-4004-9f0a-5634b64ed2e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:39.593994 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b25381d9-ea8d-4004-9f0a-5634b64ed2e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:39.602880 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b25381d9-ea8d-4004-9f0a-5634b64ed2e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.158466 Apr 12 16:21:39.603446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 227/450] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:39 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:39.962839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7b051b92-91c2-4716-89e5-2fe0b9879ac9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:39.963826 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7b051b92-91c2-4716-89e5-2fe0b9879ac9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:39.974871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b051b92-91c2-4716-89e5-2fe0b9879ac9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:39.975614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b051b92-91c2-4716-89e5-2fe0b9879ac9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:39.976884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b051b92-91c2-4716-89e5-2fe0b9879ac9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:39.977605 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b051b92-91c2-4716-89e5-2fe0b9879ac9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.115309 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7b051b92-91c2-4716-89e5-2fe0b9879ac9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:40.123203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7b051b92-91c2-4716-89e5-2fe0b9879ac9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1315 microversion: 2.1 time: 0.167709 Apr 12 16:21:40.123804 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 228/451] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:39 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:40.128334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b390e5e1-8678-41ca-b7c0-cd45a9e0e320 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:40.129013 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b390e5e1-8678-41ca-b7c0-cd45a9e0e320 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:40.135490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b390e5e1-8678-41ca-b7c0-cd45a9e0e320 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:40.135944 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b390e5e1-8678-41ca-b7c0-cd45a9e0e320 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.136719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b390e5e1-8678-41ca-b7c0-cd45a9e0e320 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:40.137156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b390e5e1-8678-41ca-b7c0-cd45a9e0e320 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.273838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b390e5e1-8678-41ca-b7c0-cd45a9e0e320 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:40.282286 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b390e5e1-8678-41ca-b7c0-cd45a9e0e320 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.157414 Apr 12 16:21:40.282859 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 229/452] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:40 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:40.292380 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:40.292983 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:40.299075 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:40.299532 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.300275 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:40.300744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.439961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:40.449188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:40.450716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:40.451887 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6df282d1-7624-4e82-ac9f-b4c1db695285 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.163095 Apr 12 16:21:40.452426 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 230/453] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:40 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:40.459501 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-40b9e2c1-bfbc-42cb-abce-e95affba06bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:40.460099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-40b9e2c1-bfbc-42cb-abce-e95affba06bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:40.465957 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-40b9e2c1-bfbc-42cb-abce-e95affba06bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:40.466428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-40b9e2c1-bfbc-42cb-abce-e95affba06bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.467187 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-40b9e2c1-bfbc-42cb-abce-e95affba06bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:40.467609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-40b9e2c1-bfbc-42cb-abce-e95affba06bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.608793 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-40b9e2c1-bfbc-42cb-abce-e95affba06bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:40.617326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-40b9e2c1-bfbc-42cb-abce-e95affba06bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.161700 Apr 12 16:21:40.617896 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 231/454] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:40 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:40.622332 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5551a6d6-3b87-4847-996d-cdce71399635 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:40.622932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5551a6d6-3b87-4847-996d-cdce71399635 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:40.629027 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5551a6d6-3b87-4847-996d-cdce71399635 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:40.629516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5551a6d6-3b87-4847-996d-cdce71399635 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.630335 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5551a6d6-3b87-4847-996d-cdce71399635 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:40.630766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5551a6d6-3b87-4847-996d-cdce71399635 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:40.760205 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5551a6d6-3b87-4847-996d-cdce71399635 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:40.767997 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5551a6d6-3b87-4847-996d-cdce71399635 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.149138 Apr 12 16:21:40.768570 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 232/455] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:40 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:41.140879 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a12653d0-dea0-472c-bfbd-c0fcded3cda2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:41.141514 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a12653d0-dea0-472c-bfbd-c0fcded3cda2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:41.148238 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a12653d0-dea0-472c-bfbd-c0fcded3cda2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.148684 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a12653d0-dea0-472c-bfbd-c0fcded3cda2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.149462 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a12653d0-dea0-472c-bfbd-c0fcded3cda2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.149870 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a12653d0-dea0-472c-bfbd-c0fcded3cda2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.285661 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f18dcc50-2279-4516-8793-16c3ca5a153e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "POST /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.236567 Apr 12 16:21:41.286636 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 224/456] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:21:37 2022] POST /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495/os-volume_attachments => generated 194 bytes in 4239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:41.304638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-015afee9-0224-45a1-863b-03868c900d7d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:41.304860 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-015afee9-0224-45a1-863b-03868c900d7d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:41.313321 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-015afee9-0224-45a1-863b-03868c900d7d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.313540 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-015afee9-0224-45a1-863b-03868c900d7d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.314201 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-015afee9-0224-45a1-863b-03868c900d7d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.314786 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-015afee9-0224-45a1-863b-03868c900d7d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.400105 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a12653d0-dea0-472c-bfbd-c0fcded3cda2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:41.411031 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a12653d0-dea0-472c-bfbd-c0fcded3cda2 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1464 microversion: 2.1 time: 0.273853 Apr 12 16:21:41.411931 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 233/457] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:41 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1464 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:41.459975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5bb9d809-0a78-449d-8081-2810442f9c7d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:41.460521 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5bb9d809-0a78-449d-8081-2810442f9c7d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:41.463490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-015afee9-0224-45a1-863b-03868c900d7d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:41.467282 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5bb9d809-0a78-449d-8081-2810442f9c7d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.467744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5bb9d809-0a78-449d-8081-2810442f9c7d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.468527 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5bb9d809-0a78-449d-8081-2810442f9c7d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.468968 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5bb9d809-0a78-449d-8081-2810442f9c7d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.471776 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-015afee9-0224-45a1-863b-03868c900d7d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.174504 Apr 12 16:21:41.472365 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 225/458] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:41 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:41.477061 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:41.477669 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:41.483539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.484007 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.484895 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.485346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.494833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5bb9d809-0a78-449d-8081-2810442f9c7d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:21:41.575460 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5bb9d809-0a78-449d-8081-2810442f9c7d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "DELETE /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 204 len: 0 microversion: 2.1 time: 0.120897 Apr 12 16:21:41.576041 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 234/459] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:21:41 2022] DELETE /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:21:41.584854 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-90c23bea-5333-416a-a4ff-7080a92e683c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:41.585540 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-90c23bea-5333-416a-a4ff-7080a92e683c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:41.591281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90c23bea-5333-416a-a4ff-7080a92e683c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.591725 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90c23bea-5333-416a-a4ff-7080a92e683c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.592485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90c23bea-5333-416a-a4ff-7080a92e683c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.592912 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90c23bea-5333-416a-a4ff-7080a92e683c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.619792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:41.627659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:41.629432 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:41.630692 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-70c76df4-7fda-4d97-aae5-25da1e9783be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.157417 Apr 12 16:21:41.631260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 226/460] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:41 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:41.635611 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f1d06aa9-4de3-4757-80b3-de9c9acb416a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:41.636241 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f1d06aa9-4de3-4757-80b3-de9c9acb416a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:41.644859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f1d06aa9-4de3-4757-80b3-de9c9acb416a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.645367 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f1d06aa9-4de3-4757-80b3-de9c9acb416a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.646176 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f1d06aa9-4de3-4757-80b3-de9c9acb416a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.646609 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f1d06aa9-4de3-4757-80b3-de9c9acb416a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.770833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-90c23bea-5333-416a-a4ff-7080a92e683c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:41.778383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-90c23bea-5333-416a-a4ff-7080a92e683c tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1470 microversion: 2.1 time: 0.197776 Apr 12 16:21:41.779156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 235/461] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:41 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:41.784875 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dca03918-b891-4b2e-bd29-2dbfd8ada14f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:41.785801 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dca03918-b891-4b2e-bd29-2dbfd8ada14f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:41.791962 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dca03918-b891-4b2e-bd29-2dbfd8ada14f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.792473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dca03918-b891-4b2e-bd29-2dbfd8ada14f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.793280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dca03918-b891-4b2e-bd29-2dbfd8ada14f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:41.793718 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dca03918-b891-4b2e-bd29-2dbfd8ada14f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:41.800262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f1d06aa9-4de3-4757-80b3-de9c9acb416a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:41.807854 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f1d06aa9-4de3-4757-80b3-de9c9acb416a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.175635 Apr 12 16:21:41.808644 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 227/462] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:41 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:41.939645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dca03918-b891-4b2e-bd29-2dbfd8ada14f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:41.947985 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dca03918-b891-4b2e-bd29-2dbfd8ada14f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.167099 Apr 12 16:21:41.948591 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 236/463] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:41 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:42.489174 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b7c1e2ec-ad10-446e-9024-a1de5dbb72d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:42.489774 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b7c1e2ec-ad10-446e-9024-a1de5dbb72d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:42.498728 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7c1e2ec-ad10-446e-9024-a1de5dbb72d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:42.499433 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7c1e2ec-ad10-446e-9024-a1de5dbb72d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:42.500674 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7c1e2ec-ad10-446e-9024-a1de5dbb72d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:42.501124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7c1e2ec-ad10-446e-9024-a1de5dbb72d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:42.630955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b7c1e2ec-ad10-446e-9024-a1de5dbb72d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:42.639290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b7c1e2ec-ad10-446e-9024-a1de5dbb72d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.154332 Apr 12 16:21:42.639862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 228/464] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:42 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:42.648910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:42.649521 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:42.655963 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:42.656391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:42.657160 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:42.657596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:42.798081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-42184644-be3a-487c-b92d-2047cea21e97 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:42.798768 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-42184644-be3a-487c-b92d-2047cea21e97 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:42.804646 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:42.806002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-42184644-be3a-487c-b92d-2047cea21e97 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:42.806485 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-42184644-be3a-487c-b92d-2047cea21e97 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:42.807261 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-42184644-be3a-487c-b92d-2047cea21e97 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:42.807694 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-42184644-be3a-487c-b92d-2047cea21e97 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:42.813070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:42.814844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:42.816062 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-53cfbc6f-74ef-491d-b135-240330b1c3a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.171170 Apr 12 16:21:42.816988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 237/465] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:42 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:42.832259 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8c80b630-ab5f-4deb-b6a0-c76f9fa90080 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:42.832892 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8c80b630-ab5f-4deb-b6a0-c76f9fa90080 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:42.839477 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c80b630-ab5f-4deb-b6a0-c76f9fa90080 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:42.840030 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c80b630-ab5f-4deb-b6a0-c76f9fa90080 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:42.840905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c80b630-ab5f-4deb-b6a0-c76f9fa90080 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:42.841306 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c80b630-ab5f-4deb-b6a0-c76f9fa90080 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:42.981462 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-42184644-be3a-487c-b92d-2047cea21e97 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:42.990338 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-42184644-be3a-487c-b92d-2047cea21e97 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1470 microversion: 2.1 time: 0.198094 Apr 12 16:21:42.991127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 229/466] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:42 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:42.995615 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-83fc6f66-109d-41ff-9e3f-66f401d82bf0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:42.996203 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-83fc6f66-109d-41ff-9e3f-66f401d82bf0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:43.002374 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-83fc6f66-109d-41ff-9e3f-66f401d82bf0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:43.002869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-83fc6f66-109d-41ff-9e3f-66f401d82bf0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:43.003619 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-83fc6f66-109d-41ff-9e3f-66f401d82bf0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:43.004198 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-83fc6f66-109d-41ff-9e3f-66f401d82bf0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:43.010280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8c80b630-ab5f-4deb-b6a0-c76f9fa90080 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:43.017726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8c80b630-ab5f-4deb-b6a0-c76f9fa90080 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.189822 Apr 12 16:21:43.018315 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 238/467] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:42 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:43.139119 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-83fc6f66-109d-41ff-9e3f-66f401d82bf0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:43.146869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-83fc6f66-109d-41ff-9e3f-66f401d82bf0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.154932 Apr 12 16:21:43.147485 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 230/468] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:42 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:43.662877 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e49cd75b-47a5-441d-b5f1-cebc32f00ef5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:43.663955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e49cd75b-47a5-441d-b5f1-cebc32f00ef5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:43.674730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e49cd75b-47a5-441d-b5f1-cebc32f00ef5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:43.675388 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e49cd75b-47a5-441d-b5f1-cebc32f00ef5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:43.676654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e49cd75b-47a5-441d-b5f1-cebc32f00ef5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:43.677096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e49cd75b-47a5-441d-b5f1-cebc32f00ef5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:43.818937 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e49cd75b-47a5-441d-b5f1-cebc32f00ef5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:43.827668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e49cd75b-47a5-441d-b5f1-cebc32f00ef5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.173266 Apr 12 16:21:43.828248 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 239/469] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:43 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:43.834752 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:43.835373 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:43.842164 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:43.842612 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:43.843387 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:43.843822 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:43.979263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:43.987292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:43.988770 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:43.989921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3403c78b-0c4d-4cf0-afb7-0740f8c29640 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.159543 Apr 12 16:21:43.990548 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 231/470] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:43 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:44.007531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-00171776-2ec7-4b85-adc4-a1cf86c031c0 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:44.008139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-00171776-2ec7-4b85-adc4-a1cf86c031c0 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:44.014761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-00171776-2ec7-4b85-adc4-a1cf86c031c0 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:44.015178 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-00171776-2ec7-4b85-adc4-a1cf86c031c0 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:44.015947 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-00171776-2ec7-4b85-adc4-a1cf86c031c0 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:44.016375 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-00171776-2ec7-4b85-adc4-a1cf86c031c0 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:44.035065 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-53903f27-90d4-4166-843b-e90d93b08f18 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:44.035790 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-53903f27-90d4-4166-843b-e90d93b08f18 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:44.042138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53903f27-90d4-4166-843b-e90d93b08f18 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:44.042528 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53903f27-90d4-4166-843b-e90d93b08f18 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:44.043295 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53903f27-90d4-4166-843b-e90d93b08f18 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:44.043728 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53903f27-90d4-4166-843b-e90d93b08f18 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:44.193599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-00171776-2ec7-4b85-adc4-a1cf86c031c0 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:44.201429 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-00171776-2ec7-4b85-adc4-a1cf86c031c0 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1470 microversion: 2.1 time: 0.197982 Apr 12 16:21:44.202273 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 240/471] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:44 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:44.207193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ad01b2a3-bb16-4822-b9e7-62f371090a2f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:44.207836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ad01b2a3-bb16-4822-b9e7-62f371090a2f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:44.213918 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ad01b2a3-bb16-4822-b9e7-62f371090a2f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:44.214427 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ad01b2a3-bb16-4822-b9e7-62f371090a2f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:44.215199 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ad01b2a3-bb16-4822-b9e7-62f371090a2f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:44.215673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ad01b2a3-bb16-4822-b9e7-62f371090a2f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:44.219853 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-53903f27-90d4-4166-843b-e90d93b08f18 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:44.228792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-53903f27-90d4-4166-843b-e90d93b08f18 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.198019 Apr 12 16:21:44.229563 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 232/472] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:44 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:44.353367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ad01b2a3-bb16-4822-b9e7-62f371090a2f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:44.365236 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ad01b2a3-bb16-4822-b9e7-62f371090a2f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.161993 Apr 12 16:21:44.365814 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 241/473] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:44 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:44.848990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8c4b3ac9-8033-458f-98fd-09c7ab936c21 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:44.849644 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8c4b3ac9-8033-458f-98fd-09c7ab936c21 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:44.856697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c4b3ac9-8033-458f-98fd-09c7ab936c21 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:44.857150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c4b3ac9-8033-458f-98fd-09c7ab936c21 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:44.857958 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c4b3ac9-8033-458f-98fd-09c7ab936c21 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:44.858501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c4b3ac9-8033-458f-98fd-09c7ab936c21 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:44.987658 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8c4b3ac9-8033-458f-98fd-09c7ab936c21 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:44.995808 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8c4b3ac9-8033-458f-98fd-09c7ab936c21 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.152782 Apr 12 16:21:44.996385 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 233/474] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:44 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:45.008749 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:45.009289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:45.015851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.016341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.017096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.017557 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.153026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:45.161400 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:45.162987 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:45.164475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-373817c1-7223-4f45-bbd3-9b33843366e2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.159951 Apr 12 16:21:45.165036 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 242/475] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:45 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:45.218844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-045c53be-c867-448b-917c-71d62191c82a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:45.219729 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-045c53be-c867-448b-917c-71d62191c82a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:45.226046 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-045c53be-c867-448b-917c-71d62191c82a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.226573 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-045c53be-c867-448b-917c-71d62191c82a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.227333 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-045c53be-c867-448b-917c-71d62191c82a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.227762 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-045c53be-c867-448b-917c-71d62191c82a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.245097 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f1e54a4a-d9c9-491d-a29d-625a76b89b45 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:45.245718 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f1e54a4a-d9c9-491d-a29d-625a76b89b45 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:45.251757 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f1e54a4a-d9c9-491d-a29d-625a76b89b45 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.252438 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f1e54a4a-d9c9-491d-a29d-625a76b89b45 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.253237 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f1e54a4a-d9c9-491d-a29d-625a76b89b45 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.254124 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f1e54a4a-d9c9-491d-a29d-625a76b89b45 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.499899 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-045c53be-c867-448b-917c-71d62191c82a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:45.505125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f1e54a4a-d9c9-491d-a29d-625a76b89b45 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:45.507918 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-045c53be-c867-448b-917c-71d62191c82a tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1470 microversion: 2.1 time: 0.293001 Apr 12 16:21:45.508586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 234/476] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:45 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:45.512601 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f1e54a4a-d9c9-491d-a29d-625a76b89b45 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.271418 Apr 12 16:21:45.518356 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 243/477] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:45 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:45.518511 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-a7fbe870-8039-47df-952f-66c06aca6b63 req-9753a63f-2655-4f8a-8dc3-5cf5a843d81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06dc15d1-6e23-4515-9016-40ecb0211696", "name": "network-vif-plugged", "status": "completed", "tag": "f49f49e8-9e2c-413a-9e10-638937a3802d"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:45.518634 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-109cc0d4-017e-4385-98b5-b7df1859aaa7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:45.518634 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-109cc0d4-017e-4385-98b5-b7df1859aaa7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:45.521918 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-a7fbe870-8039-47df-952f-66c06aca6b63 req-9753a63f-2655-4f8a-8dc3-5cf5a843d81f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.522474 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-a7fbe870-8039-47df-952f-66c06aca6b63 req-9753a63f-2655-4f8a-8dc3-5cf5a843d81f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.524292 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-109cc0d4-017e-4385-98b5-b7df1859aaa7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.524866 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-109cc0d4-017e-4385-98b5-b7df1859aaa7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.525556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-109cc0d4-017e-4385-98b5-b7df1859aaa7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:45.525984 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-109cc0d4-017e-4385-98b5-b7df1859aaa7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:45.533598 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-a7fbe870-8039-47df-952f-66c06aca6b63 req-9753a63f-2655-4f8a-8dc3-5cf5a843d81f service nova] Creating event network-vif-plugged:f49f49e8-9e2c-413a-9e10-638937a3802d for instance 06dc15d1-6e23-4515-9016-40ecb0211696 on hv-cinder-83752 Apr 12 16:21:45.538745 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-a7fbe870-8039-47df-952f-66c06aca6b63 req-9753a63f-2655-4f8a-8dc3-5cf5a843d81f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028846 Apr 12 16:21:45.539495 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 235/478] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:45.701126 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-109cc0d4-017e-4385-98b5-b7df1859aaa7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:45.711221 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-109cc0d4-017e-4385-98b5-b7df1859aaa7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.197105 Apr 12 16:21:45.711796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 244/479] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:45 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:46.018011 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1fdfd837-54a6-4213-9624-b98662cf7223 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:46.019513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1fdfd837-54a6-4213-9624-b98662cf7223 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:46.026401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1fdfd837-54a6-4213-9624-b98662cf7223 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.027188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1fdfd837-54a6-4213-9624-b98662cf7223 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.028276 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1fdfd837-54a6-4213-9624-b98662cf7223 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.028694 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1fdfd837-54a6-4213-9624-b98662cf7223 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.182945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:46.183659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:46.190540 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.191096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.191953 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.192610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.300372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1fdfd837-54a6-4213-9624-b98662cf7223 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:46.309406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1fdfd837-54a6-4213-9624-b98662cf7223 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.296490 Apr 12 16:21:46.320107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 236/480] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:46 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:46.421731 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:46.443110 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:46.446823 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:46.448574 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-242fb52f-f7f6-4ee2-82e9-6546abd13055 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1744 microversion: 2.20 time: 0.269674 Apr 12 16:21:46.449276 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 245/481] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:46 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1744 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:46.525740 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6d823450-f2af-4bcf-830c-533490ca1e92 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:46.526734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6d823450-f2af-4bcf-830c-533490ca1e92 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:46.529573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-af8759ed-8085-4973-8ffe-87302d5329fa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:46.530229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-af8759ed-8085-4973-8ffe-87302d5329fa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:46.533749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d823450-f2af-4bcf-830c-533490ca1e92 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.534511 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d823450-f2af-4bcf-830c-533490ca1e92 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.535704 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d823450-f2af-4bcf-830c-533490ca1e92 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.536331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d823450-f2af-4bcf-830c-533490ca1e92 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.537359 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af8759ed-8085-4973-8ffe-87302d5329fa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.537835 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af8759ed-8085-4973-8ffe-87302d5329fa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.538649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af8759ed-8085-4973-8ffe-87302d5329fa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.539088 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af8759ed-8085-4973-8ffe-87302d5329fa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.872045 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6d823450-f2af-4bcf-830c-533490ca1e92 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:46.880170 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6d823450-f2af-4bcf-830c-533490ca1e92 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1428 microversion: 2.1 time: 0.358908 Apr 12 16:21:46.889713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 237/482] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:46 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1428 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:46.889713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bfd69bdf-619b-4de3-8ae8-fbe1798b9cb5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:46.889713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bfd69bdf-619b-4de3-8ae8-fbe1798b9cb5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:46.896013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bfd69bdf-619b-4de3-8ae8-fbe1798b9cb5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.896467 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bfd69bdf-619b-4de3-8ae8-fbe1798b9cb5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:46.897252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bfd69bdf-619b-4de3-8ae8-fbe1798b9cb5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:46.897688 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bfd69bdf-619b-4de3-8ae8-fbe1798b9cb5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:47.039642 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-af8759ed-8085-4973-8ffe-87302d5329fa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:47.047414 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-af8759ed-8085-4973-8ffe-87302d5329fa tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.522044 Apr 12 16:21:47.048035 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 246/483] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:46 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:47.052495 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-a5808921-d3ce-4def-8b09-0c59760fa084 req-83107c48-59e9-4d0a-a4b0-95dbe42948e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090e2715-75f1-4078-8b05-6cf170656ea1", "name": "network-vif-deleted", "tag": "29d06177-36fb-4f13-a08c-b1e48832bedd"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:47.060529 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-a5808921-d3ce-4def-8b09-0c59760fa084 req-83107c48-59e9-4d0a-a4b0-95dbe42948e5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:47.060965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-a5808921-d3ce-4def-8b09-0c59760fa084 req-83107c48-59e9-4d0a-a4b0-95dbe42948e5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:47.072929 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-a5808921-d3ce-4def-8b09-0c59760fa084 req-83107c48-59e9-4d0a-a4b0-95dbe42948e5 service nova] Creating event network-vif-deleted:29d06177-36fb-4f13-a08c-b1e48832bedd for instance 090e2715-75f1-4078-8b05-6cf170656ea1 on hv-cinder-83752 Apr 12 16:21:47.077980 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-a5808921-d3ce-4def-8b09-0c59760fa084 req-83107c48-59e9-4d0a-a4b0-95dbe42948e5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028855 Apr 12 16:21:47.078810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 247/484] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:47.088019 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-bfd69bdf-619b-4de3-8ae8-fbe1798b9cb5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:47.095563 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bfd69bdf-619b-4de3-8ae8-fbe1798b9cb5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.213877 Apr 12 16:21:47.096129 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 238/485] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:46 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:47.329218 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-813d4f47-84d1-4c4a-a0dc-8f436af1a59d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:47.329901 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-813d4f47-84d1-4c4a-a0dc-8f436af1a59d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:47.337058 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-813d4f47-84d1-4c4a-a0dc-8f436af1a59d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:47.337636 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-813d4f47-84d1-4c4a-a0dc-8f436af1a59d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:47.338451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-813d4f47-84d1-4c4a-a0dc-8f436af1a59d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:47.338886 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-813d4f47-84d1-4c4a-a0dc-8f436af1a59d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:47.467575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:47.468206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:47.474563 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:47.475006 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:47.475747 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:47.476197 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:47.483743 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-813d4f47-84d1-4c4a-a0dc-8f436af1a59d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:47.492085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-813d4f47-84d1-4c4a-a0dc-8f436af1a59d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.168033 Apr 12 16:21:47.492864 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 248/486] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:47 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:47.607486 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:47.620898 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:47.623049 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:47.624704 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c6415e9a-b3f9-4d76-ab81-1ce687c1bc0a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1744 microversion: 2.20 time: 0.160761 Apr 12 16:21:47.625847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 239/487] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:47 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:47.897847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-33f467e2-ae2a-4e77-9303-df54bfbdc2f9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:47.898487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-33f467e2-ae2a-4e77-9303-df54bfbdc2f9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:47.904592 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-33f467e2-ae2a-4e77-9303-df54bfbdc2f9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:47.905051 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-33f467e2-ae2a-4e77-9303-df54bfbdc2f9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:47.905819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-33f467e2-ae2a-4e77-9303-df54bfbdc2f9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:47.906294 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-33f467e2-ae2a-4e77-9303-df54bfbdc2f9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:47.974809 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-33f467e2-ae2a-4e77-9303-df54bfbdc2f9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:47.984001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-33f467e2-ae2a-4e77-9303-df54bfbdc2f9 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1300 microversion: 2.1 time: 0.090234 Apr 12 16:21:47.984576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 249/488] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:47 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:48.064044 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b02226d0-a5b4-4c4a-93d3-aa28f0190076 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:48.064719 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b02226d0-a5b4-4c4a-93d3-aa28f0190076 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:48.072403 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b02226d0-a5b4-4c4a-93d3-aa28f0190076 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:48.072847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b02226d0-a5b4-4c4a-93d3-aa28f0190076 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:48.073696 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b02226d0-a5b4-4c4a-93d3-aa28f0190076 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:48.074271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b02226d0-a5b4-4c4a-93d3-aa28f0190076 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:48.116169 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6151ac96-81d0-47c2-b0de-d2ed0da8a286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:48.116788 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6151ac96-81d0-47c2-b0de-d2ed0da8a286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:48.123446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6151ac96-81d0-47c2-b0de-d2ed0da8a286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:48.123900 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6151ac96-81d0-47c2-b0de-d2ed0da8a286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:48.124806 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6151ac96-81d0-47c2-b0de-d2ed0da8a286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:48.125248 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6151ac96-81d0-47c2-b0de-d2ed0da8a286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:48.275338 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b02226d0-a5b4-4c4a-93d3-aa28f0190076 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:48.283142 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b02226d0-a5b4-4c4a-93d3-aa28f0190076 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.222913 Apr 12 16:21:48.283719 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 240/489] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:48 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:48.302795 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6151ac96-81d0-47c2-b0de-d2ed0da8a286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:48.310428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6151ac96-81d0-47c2-b0de-d2ed0da8a286 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.198497 Apr 12 16:21:48.311006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 250/490] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:48 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:48.513409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8efe6836-212a-4b60-8c87-44fb7d983a95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:48.514352 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8efe6836-212a-4b60-8c87-44fb7d983a95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:48.524659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8efe6836-212a-4b60-8c87-44fb7d983a95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:48.525383 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8efe6836-212a-4b60-8c87-44fb7d983a95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:48.526729 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8efe6836-212a-4b60-8c87-44fb7d983a95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:48.527461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8efe6836-212a-4b60-8c87-44fb7d983a95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:48.645134 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:48.645775 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:48.652906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:48.653360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:48.654178 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:48.654615 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:48.674527 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8efe6836-212a-4b60-8c87-44fb7d983a95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:48.682641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8efe6836-212a-4b60-8c87-44fb7d983a95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.175677 Apr 12 16:21:48.683206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 241/491] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:48 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:48.790376 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:48.798098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:48.799594 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:48.800805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e3a065cc-f88e-4bb2-92a3-1b3aee46eab0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1744 microversion: 2.20 time: 0.159725 Apr 12 16:21:48.801323 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 251/492] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:48 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:49.004289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:49.005128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:49.014638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.015331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.016497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.017161 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.047562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.048009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.048444 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lazy-loading 'fault' on Instance uuid 090e2715-75f1-4078-8b05-6cf170656ea1 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:21:49.097266 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:49.105124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6b5c14ff-a6d8-432f-86a0-4a7044d83763 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1305 microversion: 2.1 time: 0.107028 Apr 12 16:21:49.105679 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 242/493] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:48 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:49.291808 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-b55ada5e-f5c3-4fba-8433-b10511b27319 req-26145b50-f8ca-4377-898b-af49929793f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f48c36-5e37-4640-b589-df261265d809", "name": "network-vif-plugged", "status": "completed", "tag": "aaca632c-41bc-43f8-8889-7aea0e458ffa"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:49.300753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-114423ac-d172-467a-baec-2b6346121ad2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:49.301293 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b55ada5e-f5c3-4fba-8433-b10511b27319 req-26145b50-f8ca-4377-898b-af49929793f2 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.301484 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-114423ac-d172-467a-baec-2b6346121ad2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:49.301733 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b55ada5e-f5c3-4fba-8433-b10511b27319 req-26145b50-f8ca-4377-898b-af49929793f2 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.308267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-114423ac-d172-467a-baec-2b6346121ad2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.308887 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-114423ac-d172-467a-baec-2b6346121ad2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.309815 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-114423ac-d172-467a-baec-2b6346121ad2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.311857 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-114423ac-d172-467a-baec-2b6346121ad2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.315005 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-b55ada5e-f5c3-4fba-8433-b10511b27319 req-26145b50-f8ca-4377-898b-af49929793f2 service nova] Creating event network-vif-plugged:aaca632c-41bc-43f8-8889-7aea0e458ffa for instance 29f48c36-5e37-4640-b589-df261265d809 on hv-cinder-83752 Apr 12 16:21:49.320266 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-b55ada5e-f5c3-4fba-8433-b10511b27319 req-26145b50-f8ca-4377-898b-af49929793f2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032169 Apr 12 16:21:49.321067 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 252/494] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:49.327156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e3d17886-1599-434a-830e-2b6e89fd16eb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:49.327849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e3d17886-1599-434a-830e-2b6e89fd16eb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:49.334613 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3d17886-1599-434a-830e-2b6e89fd16eb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.335069 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3d17886-1599-434a-830e-2b6e89fd16eb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.335900 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3d17886-1599-434a-830e-2b6e89fd16eb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.336276 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3d17886-1599-434a-830e-2b6e89fd16eb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.510908 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-114423ac-d172-467a-baec-2b6346121ad2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:49.515062 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e3d17886-1599-434a-830e-2b6e89fd16eb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:49.518781 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-114423ac-d172-467a-baec-2b6346121ad2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.222514 Apr 12 16:21:49.519639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 243/495] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:49 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:49.522745 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e3d17886-1599-434a-830e-2b6e89fd16eb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.199526 Apr 12 16:21:49.523344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 253/496] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:49 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:49.702296 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d70203cb-f642-46bb-84ad-7d446a9008aa tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:49.702951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d70203cb-f642-46bb-84ad-7d446a9008aa tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:49.710792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d70203cb-f642-46bb-84ad-7d446a9008aa tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.711243 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d70203cb-f642-46bb-84ad-7d446a9008aa tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.714353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d70203cb-f642-46bb-84ad-7d446a9008aa tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.714829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d70203cb-f642-46bb-84ad-7d446a9008aa tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.824902 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:49.825627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:49.832896 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.833488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.834417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:49.834873 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:49.859453 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d70203cb-f642-46bb-84ad-7d446a9008aa tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:49.868031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d70203cb-f642-46bb-84ad-7d446a9008aa tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.170774 Apr 12 16:21:49.868599 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 244/497] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:49 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:49.976533 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:49.987457 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:49.989732 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:49.991530 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6ab72c01-c7ea-43b0-b7b4-650b02944a6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1744 microversion: 2.20 time: 0.170392 Apr 12 16:21:49.992192 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 254/498] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:49 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:50.127392 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:50.128394 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:50.135634 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.136080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:50.136868 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.137277 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:50.174916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.175509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:50.176070 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lazy-loading 'fault' on Instance uuid 090e2715-75f1-4078-8b05-6cf170656ea1 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:21:50.222514 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:50.235758 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-271f243f-b873-4419-b928-d0c2332c9eb4 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1305 microversion: 2.1 time: 0.114093 Apr 12 16:21:50.236030 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 245/499] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:50 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:50.536638 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b8123e62-2008-4c34-8d86-345971289d05 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:50.537171 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b8123e62-2008-4c34-8d86-345971289d05 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:50.539904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-35443a3f-4069-48df-8939-508cdcf55c7f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:50.540519 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-35443a3f-4069-48df-8939-508cdcf55c7f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:50.543768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b8123e62-2008-4c34-8d86-345971289d05 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.544289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b8123e62-2008-4c34-8d86-345971289d05 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:50.545118 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b8123e62-2008-4c34-8d86-345971289d05 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.545628 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b8123e62-2008-4c34-8d86-345971289d05 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:50.546622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-35443a3f-4069-48df-8939-508cdcf55c7f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.547440 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-35443a3f-4069-48df-8939-508cdcf55c7f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:50.547838 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-35443a3f-4069-48df-8939-508cdcf55c7f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.548243 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-35443a3f-4069-48df-8939-508cdcf55c7f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:50.749811 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b8123e62-2008-4c34-8d86-345971289d05 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:50.753076 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-35443a3f-4069-48df-8939-508cdcf55c7f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:50.757964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b8123e62-2008-4c34-8d86-345971289d05 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1365 microversion: 2.1 time: 0.225665 Apr 12 16:21:50.758577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 255/500] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:50 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:50.762807 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-35443a3f-4069-48df-8939-508cdcf55c7f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1507 microversion: 2.1 time: 0.226116 Apr 12 16:21:50.763790 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 246/501] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:50 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:50.887409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cc5b8292-a5b3-4836-8697-59d346a3d2d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:50.888035 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cc5b8292-a5b3-4836-8697-59d346a3d2d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:50.897303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc5b8292-a5b3-4836-8697-59d346a3d2d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.897934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc5b8292-a5b3-4836-8697-59d346a3d2d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:50.899067 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc5b8292-a5b3-4836-8697-59d346a3d2d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:50.899577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc5b8292-a5b3-4836-8697-59d346a3d2d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.014259 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:51.014983 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:51.021262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.021715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.022506 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.022946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.037221 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cc5b8292-a5b3-4836-8697-59d346a3d2d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:51.045027 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cc5b8292-a5b3-4836-8697-59d346a3d2d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.163317 Apr 12 16:21:51.045579 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 256/502] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:50 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:51.152507 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:51.161128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:51.162670 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:51.163826 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c7372eea-ebc8-4198-9116-c9692e0e3fdc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1744 microversion: 2.20 time: 0.153605 Apr 12 16:21:51.164389 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 247/503] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:51 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:21:51.256250 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:51.257202 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:51.266817 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.267464 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.268653 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.269451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.299280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.299722 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.300167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lazy-loading 'fault' on Instance uuid 090e2715-75f1-4078-8b05-6cf170656ea1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:21:51.342611 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:51.350291 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-af96a372-899e-440a-9617-3495e9128b5e tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1305 microversion: 2.1 time: 0.100287 Apr 12 16:21:51.350788 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 257/504] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:51 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:51.777011 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bc11c7ff-0a46-4a99-be78-7d3456ea2ea7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:51.778729 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bc11c7ff-0a46-4a99-be78-7d3456ea2ea7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:51.782503 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9fffce36-2d9e-4843-bf3a-0c89cd96d9f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:51.783144 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9fffce36-2d9e-4843-bf3a-0c89cd96d9f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:51.787886 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bc11c7ff-0a46-4a99-be78-7d3456ea2ea7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.788952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bc11c7ff-0a46-4a99-be78-7d3456ea2ea7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.789511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fffce36-2d9e-4843-bf3a-0c89cd96d9f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.790126 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fffce36-2d9e-4843-bf3a-0c89cd96d9f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.790276 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bc11c7ff-0a46-4a99-be78-7d3456ea2ea7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.790817 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fffce36-2d9e-4843-bf3a-0c89cd96d9f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:51.790952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bc11c7ff-0a46-4a99-be78-7d3456ea2ea7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:51.791228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fffce36-2d9e-4843-bf3a-0c89cd96d9f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.027818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-bc11c7ff-0a46-4a99-be78-7d3456ea2ea7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:52.034851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9fffce36-2d9e-4843-bf3a-0c89cd96d9f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:52.036309 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bc11c7ff-0a46-4a99-be78-7d3456ea2ea7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1556 microversion: 2.1 time: 0.264125 Apr 12 16:21:52.036968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 248/505] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:51 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1556 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:52.043089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9fffce36-2d9e-4843-bf3a-0c89cd96d9f6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1513 microversion: 2.1 time: 0.264341 Apr 12 16:21:52.043659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 258/506] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:51 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:52.060504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6a1bf1ee-9411-46df-bdc0-47affc94f8f7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:52.061812 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6a1bf1ee-9411-46df-bdc0-47affc94f8f7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:52.063730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-efe6ae15-061b-41cf-ad83-2355511b3d3d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:52.064971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-efe6ae15-061b-41cf-ad83-2355511b3d3d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:52.071715 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-efe6ae15-061b-41cf-ad83-2355511b3d3d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.072170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-efe6ae15-061b-41cf-ad83-2355511b3d3d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.072956 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-efe6ae15-061b-41cf-ad83-2355511b3d3d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.073394 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-efe6ae15-061b-41cf-ad83-2355511b3d3d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.073520 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6a1bf1ee-9411-46df-bdc0-47affc94f8f7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.073900 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6a1bf1ee-9411-46df-bdc0-47affc94f8f7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.074935 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6a1bf1ee-9411-46df-bdc0-47affc94f8f7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.075163 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6a1bf1ee-9411-46df-bdc0-47affc94f8f7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.211222 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6a1bf1ee-9411-46df-bdc0-47affc94f8f7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160055 Apr 12 16:21:52.212797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 249/507] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Apr 12 16:21:52 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:52.221451 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:52.223797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:52.235082 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.236246 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.237736 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.240409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.267146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-efe6ae15-061b-41cf-ad83-2355511b3d3d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:52.282086 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-efe6ae15-061b-41cf-ad83-2355511b3d3d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.222265 Apr 12 16:21:52.295050 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 259/508] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:52 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:52.367784 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:52.368827 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:52.376956 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.377810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.379385 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.380051 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.415978 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:52.425621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:52.427213 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:52.428477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-eb5c836b-26fc-4b5c-9d14-e695b23ad08a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1744 microversion: 2.20 time: 0.214220 Apr 12 16:21:52.430074 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 250/509] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:52 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:52.461768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:52.462401 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:52.463054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lazy-loading 'fault' on Instance uuid 090e2715-75f1-4078-8b05-6cf170656ea1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:21:52.517008 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:52.526024 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b06abf55-982c-452d-8a61-eb28bb9a5e21 tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1305 microversion: 2.1 time: 0.163157 Apr 12 16:21:52.527014 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 260/510] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:52 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1305 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:53.308544 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0ff365b3-51b2-40d1-a007-b04ac6eb8c13 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:53.309467 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0ff365b3-51b2-40d1-a007-b04ac6eb8c13 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:53.317507 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0ff365b3-51b2-40d1-a007-b04ac6eb8c13 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:53.318235 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0ff365b3-51b2-40d1-a007-b04ac6eb8c13 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:53.319416 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0ff365b3-51b2-40d1-a007-b04ac6eb8c13 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:53.320094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0ff365b3-51b2-40d1-a007-b04ac6eb8c13 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:53.454371 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:53.457606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:53.475518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:53.476194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:53.477188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:53.477807 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:53.496455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0ff365b3-51b2-40d1-a007-b04ac6eb8c13 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:53.522066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0ff365b3-51b2-40d1-a007-b04ac6eb8c13 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.217585 Apr 12 16:21:53.526382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 251/511] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:53 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:53.531283 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-e972b6f1-d812-44bc-9a64-2458ef69c918 req-51785965-fb64-4f69-9920-205548377597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06dc15d1-6e23-4515-9016-40ecb0211696", "tag": "f49f49e8-9e2c-413a-9e10-638937a3802d"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:53.543010 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-e972b6f1-d812-44bc-9a64-2458ef69c918 req-51785965-fb64-4f69-9920-205548377597 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:53.543540 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-e972b6f1-d812-44bc-9a64-2458ef69c918 req-51785965-fb64-4f69-9920-205548377597 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:53.558487 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-e972b6f1-d812-44bc-9a64-2458ef69c918 req-51785965-fb64-4f69-9920-205548377597 service nova] Creating event network-changed:f49f49e8-9e2c-413a-9e10-638937a3802d for instance 06dc15d1-6e23-4515-9016-40ecb0211696 on hv-cinder-83752 Apr 12 16:21:53.563659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-e972b6f1-d812-44bc-9a64-2458ef69c918 req-51785965-fb64-4f69-9920-205548377597 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035787 Apr 12 16:21:53.564535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 252/512] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:53.572737 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:53.573607 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:53.582090 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:53.582525 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:53.583437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:53.583795 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:53.619074 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:53.619523 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:53.619967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lazy-loading 'fault' on Instance uuid 090e2715-75f1-4078-8b05-6cf170656ea1 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:21:53.675078 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5385e0d499a6419fb1faea4af8783f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4224329892c14501a19cf44244ea0f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:53.684989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-474b92b5-c8fe-4ce4-98c4-0e3562e3397d tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 200 len: 1305 microversion: 2.1 time: 0.119300 Apr 12 16:21:53.686179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 253/513] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:53 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:53.692414 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4721d245-92eb-4c59-bf44-4eb50c6616a6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'create', calling method: .version_select at 0x7f246dbd7c10>, body: {"keypair": {"name": "tempest-keypair-1778657825"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:53.697575 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:53.707189 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:53.709061 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:53.709584 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-4721d245-92eb-4c59-bf44-4eb50c6616a6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for project edcd271496524c94929c1a28a63f96ef. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:21:53.710643 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e14c4b0a-0e4f-4f06-bdf9-cb748ef1a567 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1744 microversion: 2.20 time: 0.267365 Apr 12 16:21:53.711429 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 261/514] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:53 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1744 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:21:53.722081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-4721d245-92eb-4c59-bf44-4eb50c6616a6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for user e0a8dd6313744c0bac80289882e9b78d and project edcd271496524c94929c1a28a63f96ef. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:21:53.900923 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-4721d245-92eb-4c59-bf44-4eb50c6616a6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for project edcd271496524c94929c1a28a63f96ef. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:21:53.904534 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-4721d245-92eb-4c59-bf44-4eb50c6616a6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for user e0a8dd6313744c0bac80289882e9b78d and project edcd271496524c94929c1a28a63f96ef. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:21:53.917632 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4721d245-92eb-4c59-bf44-4eb50c6616a6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.230361 Apr 12 16:21:53.918355 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 254/515] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:21:53 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:54.541483 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-03ca53be-1338-4046-b168-72c79f29f45b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:54.542272 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-03ca53be-1338-4046-b168-72c79f29f45b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:54.557334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03ca53be-1338-4046-b168-72c79f29f45b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:54.559032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03ca53be-1338-4046-b168-72c79f29f45b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:54.560668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03ca53be-1338-4046-b168-72c79f29f45b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:54.561392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03ca53be-1338-4046-b168-72c79f29f45b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:54.710799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:54.713396 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] [instance: 090e2715-75f1-4078-8b05-6cf170656ea1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:54.728914 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:54.730150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:54.731984 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:54.733327 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:54.734585 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-03ca53be-1338-4046-b168-72c79f29f45b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:54.745124 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-03ca53be-1338-4046-b168-72c79f29f45b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1699 microversion: 2.1 time: 0.207487 Apr 12 16:21:54.746445 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 262/516] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:54 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1699 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:54.751136 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:54.751819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:54.760254 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] HTTP exception thrown: Instance 090e2715-75f1-4078-8b05-6cf170656ea1 could not be found. Apr 12 16:21:54.761280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:54.761770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:54.762553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] Returning 404 to user: Instance 090e2715-75f1-4078-8b05-6cf170656ea1 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:21:54.763542 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:54.764109 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:54.764961 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3397487f-7841-4301-9a99-4681e3d982cf tempest-VolumesNegativeTest-1153589481 tempest-VolumesNegativeTest-1153589481-project] 10.222.0.67 "GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1" status: 404 len: 111 microversion: 2.1 time: 0.064626 Apr 12 16:21:54.766640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 255/517] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:54 2022] GET /compute/v2.1/servers/090e2715-75f1-4078-8b05-6cf170656ea1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:21:54.775897 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-471181f2-18e9-4d17-a532-7d74e44ab617 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:54.794124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-471181f2-18e9-4d17-a532-7d74e44ab617 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:54.795212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-471181f2-18e9-4d17-a532-7d74e44ab617 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:54.901728 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-471181f2-18e9-4d17-a532-7d74e44ab617 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Going to try to start instance {{(pid=117201) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 12 16:21:54.980298 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-471181f2-18e9-4d17-a532-7d74e44ab617 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/action" status: 202 len: 0 microversion: 2.1 time: 0.211205 Apr 12 16:21:54.981426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 256/518] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:21:54 2022] POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:21:54.993905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:54.996004 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e454daaf-4ffc-43a6-ac2b-fe4df623748a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:54.997705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e454daaf-4ffc-43a6-ac2b-fe4df623748a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:55.008582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e454daaf-4ffc-43a6-ac2b-fe4df623748a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:55.009299 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e454daaf-4ffc-43a6-ac2b-fe4df623748a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:55.010252 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:55.010527 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e454daaf-4ffc-43a6-ac2b-fe4df623748a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:55.011194 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e454daaf-4ffc-43a6-ac2b-fe4df623748a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:55.011763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:55.013073 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c91809a5-aae0-4769-8bb9-1a4647731822 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1744 microversion: 2.20 time: 0.265675 Apr 12 16:21:55.013632 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 263/519] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:54 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1744 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:55.276881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e454daaf-4ffc-43a6-ac2b-fe4df623748a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:55.285893 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e454daaf-4ffc-43a6-ac2b-fe4df623748a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.298052 Apr 12 16:21:55.295486 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 257/520] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:54 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:55.548684 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1964455008", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a816f2a-7737-4dcf-8e4f-8a7eee1e8062"}], "security_groups": [{"name": "tempest-securitygroup--1935498906"}], "key_name": "tempest-keypair-1778657825", "user_data": "}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:55.666931 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] validate_networks() for [('1a816f2a-7737-4dcf-8e4f-8a7eee1e8062', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:21:56.040239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:56.041463 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:56.048397 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:56.048877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:56.049624 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:56.050336 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:56.208740 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:21:56.209162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:21:56.209632 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:21:56.210122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:21:56.210515 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:21:56.227467 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:56.228463 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:56.229698 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:56.230558 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:56.281831 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for project edcd271496524c94929c1a28a63f96ef. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:21:56.291292 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Getting quotas for user e0a8dd6313744c0bac80289882e9b78d and project edcd271496524c94929c1a28a63f96ef. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:21:56.299313 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:56.313512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:56.315055 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:56.315769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:21:56.316724 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f9631d73-77f9-48ab-8945-2b79ab6565de tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.280594 Apr 12 16:21:56.319521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 258/521] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:56 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:56.322299 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:21:56.335532 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-137b7911-14d8-493a-9c19-18f4165b5375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:56.336171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-137b7911-14d8-493a-9c19-18f4165b5375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:56.346671 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-137b7911-14d8-493a-9c19-18f4165b5375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:56.347441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-137b7911-14d8-493a-9c19-18f4165b5375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:56.348454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-137b7911-14d8-493a-9c19-18f4165b5375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:56.349233 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-137b7911-14d8-493a-9c19-18f4165b5375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:56.439570 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0c37b6e8-e07b-40f1-b587-a6fb4e547cdb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.896212 Apr 12 16:21:56.440459 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 264/522] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:21:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:21:56.453914 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2e0d4aaf-2a97-4b2d-ab8c-b75e6d7b2816 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:56.454925 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2e0d4aaf-2a97-4b2d-ab8c-b75e6d7b2816 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:56.561211 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2e0d4aaf-2a97-4b2d-ab8c-b75e6d7b2816 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:56.568861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2e0d4aaf-2a97-4b2d-ab8c-b75e6d7b2816 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1246 microversion: 2.1 time: 0.118858 Apr 12 16:21:56.569863 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 265/523] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:56 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:21:56.641156 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-137b7911-14d8-493a-9c19-18f4165b5375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:56.649700 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-137b7911-14d8-493a-9c19-18f4165b5375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.329135 Apr 12 16:21:56.650575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 259/524] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:56 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:57.339461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:57.340516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:57.348726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:57.349187 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:57.350405 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:57.351022 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:57.589138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cd6e09d3-39ab-45a8-93e3-c0852bdcca6d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:57.589138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-cd6e09d3-39ab-45a8-93e3-c0852bdcca6d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:57.597997 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd6e09d3-39ab-45a8-93e3-c0852bdcca6d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:57.598482 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd6e09d3-39ab-45a8-93e3-c0852bdcca6d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:57.599252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd6e09d3-39ab-45a8-93e3-c0852bdcca6d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:57.601746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd6e09d3-39ab-45a8-93e3-c0852bdcca6d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:57.850337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-cd6e09d3-39ab-45a8-93e3-c0852bdcca6d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:57.861097 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-cd6e09d3-39ab-45a8-93e3-c0852bdcca6d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1242 microversion: 2.1 time: 0.279190 Apr 12 16:21:57.861712 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 260/525] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:57 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1242 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:57.880036 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b7c3f78b-69cf-4cc4-a96c-25254d622af1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:57.880036 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b7c3f78b-69cf-4cc4-a96c-25254d622af1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:57.891676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7c3f78b-69cf-4cc4-a96c-25254d622af1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:57.891676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7c3f78b-69cf-4cc4-a96c-25254d622af1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:57.891676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7c3f78b-69cf-4cc4-a96c-25254d622af1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:57.891676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7c3f78b-69cf-4cc4-a96c-25254d622af1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:57.899848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:57.911402 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:57.912863 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:57.914019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3915d600-b9b7-4f12-8ba1-6abd834ee2db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.578479 Apr 12 16:21:57.914610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 266/526] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:57 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:58.094071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b7c3f78b-69cf-4cc4-a96c-25254d622af1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:58.102494 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b7c3f78b-69cf-4cc4-a96c-25254d622af1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.239609 Apr 12 16:21:58.103082 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 261/527] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:57 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:58.897070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-618c323d-8c21-4e45-8007-5acc3d0d613b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:58.897682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-618c323d-8c21-4e45-8007-5acc3d0d613b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:58.904533 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-618c323d-8c21-4e45-8007-5acc3d0d613b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:58.905215 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-618c323d-8c21-4e45-8007-5acc3d0d613b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:58.905935 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-618c323d-8c21-4e45-8007-5acc3d0d613b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:58.906402 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-618c323d-8c21-4e45-8007-5acc3d0d613b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:58.932001 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:58.933536 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:58.940356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:58.941368 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:58.942601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:58.943269 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:58.986223 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-618c323d-8c21-4e45-8007-5acc3d0d613b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:58.994385 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-618c323d-8c21-4e45-8007-5acc3d0d613b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1306 microversion: 2.1 time: 0.101265 Apr 12 16:21:58.995033 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 267/528] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:58 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:59.110836 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:59.120543 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ce5e2a6b-7385-4145-b618-4dd32d1af8c2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:59.121160 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ce5e2a6b-7385-4145-b618-4dd32d1af8c2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:21:59.133687 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ce5e2a6b-7385-4145-b618-4dd32d1af8c2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:59.134164 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ce5e2a6b-7385-4145-b618-4dd32d1af8c2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:59.134954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ce5e2a6b-7385-4145-b618-4dd32d1af8c2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:21:59.135391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ce5e2a6b-7385-4145-b618-4dd32d1af8c2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:21:59.139101 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:59.140945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:59.142167 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0192bd1b-f7fc-484c-a597-e3afdc187a41 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.214114 Apr 12 16:21:59.153938 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 262/529] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:21:58 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:21:59.294639 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ce5e2a6b-7385-4145-b618-4dd32d1af8c2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:21:59.304291 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ce5e2a6b-7385-4145-b618-4dd32d1af8c2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.189172 Apr 12 16:21:59.304981 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 268/530] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:21:59 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:00.014057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-40e34797-8fc7-46e2-90aa-bd180bebd50c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:00.015307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-40e34797-8fc7-46e2-90aa-bd180bebd50c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:00.024644 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-40e34797-8fc7-46e2-90aa-bd180bebd50c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:00.025325 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-40e34797-8fc7-46e2-90aa-bd180bebd50c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:00.026349 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-40e34797-8fc7-46e2-90aa-bd180bebd50c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:00.026986 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-40e34797-8fc7-46e2-90aa-bd180bebd50c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:00.099145 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-40e34797-8fc7-46e2-90aa-bd180bebd50c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:00.108649 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-40e34797-8fc7-46e2-90aa-bd180bebd50c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1306 microversion: 2.1 time: 0.099686 Apr 12 16:22:00.109239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 263/531] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:00 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:00.161434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:00.162940 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:00.169847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:00.170579 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:00.171610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:00.172209 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:00.323756 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6ca82f7d-be4c-4ee0-8af7-8e78a66f56f7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:00.324978 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6ca82f7d-be4c-4ee0-8af7-8e78a66f56f7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:00.336188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6ca82f7d-be4c-4ee0-8af7-8e78a66f56f7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:00.336188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6ca82f7d-be4c-4ee0-8af7-8e78a66f56f7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:00.336188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6ca82f7d-be4c-4ee0-8af7-8e78a66f56f7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:00.336188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6ca82f7d-be4c-4ee0-8af7-8e78a66f56f7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:00.338316 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:00.346818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:00.349137 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:00.350627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5c054496-2188-4877-8d67-5f5f2de93688 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.193660 Apr 12 16:22:00.351684 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 269/532] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:00 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:00.487842 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6ca82f7d-be4c-4ee0-8af7-8e78a66f56f7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:00.496391 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6ca82f7d-be4c-4ee0-8af7-8e78a66f56f7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.176434 Apr 12 16:22:00.496985 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 264/533] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:00 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:01.124705 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dff55f20-97bc-4dd4-bd78-ddc321035468 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:01.132762 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dff55f20-97bc-4dd4-bd78-ddc321035468 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:01.139581 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dff55f20-97bc-4dd4-bd78-ddc321035468 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:01.140007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dff55f20-97bc-4dd4-bd78-ddc321035468 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:01.140809 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dff55f20-97bc-4dd4-bd78-ddc321035468 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:01.141236 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dff55f20-97bc-4dd4-bd78-ddc321035468 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:01.216600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dff55f20-97bc-4dd4-bd78-ddc321035468 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:01.230585 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dff55f20-97bc-4dd4-bd78-ddc321035468 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1306 microversion: 2.1 time: 0.109638 Apr 12 16:22:01.231243 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 270/534] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:01 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:01.371121 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:01.372459 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:01.379756 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:01.380210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:01.381060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:01.381505 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:01.514644 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c43e87fc-6b8d-4183-b4fd-d87d324480d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:01.515835 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c43e87fc-6b8d-4183-b4fd-d87d324480d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:01.523509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c43e87fc-6b8d-4183-b4fd-d87d324480d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:01.524325 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c43e87fc-6b8d-4183-b4fd-d87d324480d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:01.525402 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c43e87fc-6b8d-4183-b4fd-d87d324480d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:01.526136 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c43e87fc-6b8d-4183-b4fd-d87d324480d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:01.858732 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:01.867005 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:01.871897 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:01.878732 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-aec92b1c-d836-41bc-baeb-5bafd4dfe55f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.507982 Apr 12 16:22:01.889823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 265/535] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:01 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:01.897767 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c43e87fc-6b8d-4183-b4fd-d87d324480d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:01.906399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c43e87fc-6b8d-4183-b4fd-d87d324480d5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.395993 Apr 12 16:22:01.906996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 271/536] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:01 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:02.247467 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8dc864d2-22db-4347-9123-ca69ccf1add1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:02.248084 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8dc864d2-22db-4347-9123-ca69ccf1add1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:02.254854 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8dc864d2-22db-4347-9123-ca69ccf1add1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:02.255313 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8dc864d2-22db-4347-9123-ca69ccf1add1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:02.259708 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8dc864d2-22db-4347-9123-ca69ccf1add1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:02.259708 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8dc864d2-22db-4347-9123-ca69ccf1add1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:02.323855 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8dc864d2-22db-4347-9123-ca69ccf1add1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:02.335724 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8dc864d2-22db-4347-9123-ca69ccf1add1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1306 microversion: 2.1 time: 0.089195 Apr 12 16:22:02.337049 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 266/537] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:02 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:02.903104 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:02.904838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:02.924728 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:02.925597 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:02.925959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-72cf926f-9a5d-48d4-80f6-685b2d39743f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:02.926579 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:02.927546 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-72cf926f-9a5d-48d4-80f6-685b2d39743f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:02.928440 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:02.943131 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-72cf926f-9a5d-48d4-80f6-685b2d39743f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:02.946289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-72cf926f-9a5d-48d4-80f6-685b2d39743f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:02.949550 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-72cf926f-9a5d-48d4-80f6-685b2d39743f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:02.950591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-72cf926f-9a5d-48d4-80f6-685b2d39743f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:03.308724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:03.328342 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:03.330941 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:03.332613 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a9d6f458-5874-4881-a09a-4b31c568c6c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.437537 Apr 12 16:22:03.335027 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 272/538] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:02 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:03.338659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-72cf926f-9a5d-48d4-80f6-685b2d39743f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:03.353333 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bb2cb33b-2809-48bc-b75e-9261c6b6c1b2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:03.355604 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-72cf926f-9a5d-48d4-80f6-685b2d39743f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.435059 Apr 12 16:22:03.356745 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 267/539] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:02 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:03.359170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bb2cb33b-2809-48bc-b75e-9261c6b6c1b2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:03.373506 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bb2cb33b-2809-48bc-b75e-9261c6b6c1b2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:03.374072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bb2cb33b-2809-48bc-b75e-9261c6b6c1b2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:03.374965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bb2cb33b-2809-48bc-b75e-9261c6b6c1b2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:03.375475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bb2cb33b-2809-48bc-b75e-9261c6b6c1b2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:03.545876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bb2cb33b-2809-48bc-b75e-9261c6b6c1b2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:03.587279 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bb2cb33b-2809-48bc-b75e-9261c6b6c1b2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1304 microversion: 2.1 time: 0.237166 Apr 12 16:22:03.589549 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 273/540] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:03 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1304 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:04.353606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:04.354251 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:04.360508 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:04.361137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:04.362503 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:04.363638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:04.379657 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8cd48c62-8533-455c-a516-e84de11b9bf8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:04.380354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8cd48c62-8533-455c-a516-e84de11b9bf8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:04.392683 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8cd48c62-8533-455c-a516-e84de11b9bf8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:04.393372 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8cd48c62-8533-455c-a516-e84de11b9bf8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:04.394504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8cd48c62-8533-455c-a516-e84de11b9bf8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:04.395119 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8cd48c62-8533-455c-a516-e84de11b9bf8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:04.591165 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:04.599744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:04.601246 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:04.607970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c426d7c8-6753-4c91-b8fd-ce5ab9009aaa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.253534 Apr 12 16:22:04.608709 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 268/541] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:04 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:04.631328 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6614d509-09bc-44e2-8e17-895df2ead6d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:04.634786 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6614d509-09bc-44e2-8e17-895df2ead6d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:04.648071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6614d509-09bc-44e2-8e17-895df2ead6d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:04.648883 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6614d509-09bc-44e2-8e17-895df2ead6d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:04.653285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6614d509-09bc-44e2-8e17-895df2ead6d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:04.653979 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6614d509-09bc-44e2-8e17-895df2ead6d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:04.672988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8cd48c62-8533-455c-a516-e84de11b9bf8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:04.684665 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8cd48c62-8533-455c-a516-e84de11b9bf8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.308571 Apr 12 16:22:04.685821 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 274/542] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:04 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:04.809296 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6614d509-09bc-44e2-8e17-895df2ead6d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:04.818443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6614d509-09bc-44e2-8e17-895df2ead6d2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.191641 Apr 12 16:22:04.819316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 269/543] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:04 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:05.628830 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:05.630387 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:05.637284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:05.638171 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:05.639169 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:05.639818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:05.702598 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-261c41ee-9e16-4bd0-87c1-28586d35c78a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:05.704498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-261c41ee-9e16-4bd0-87c1-28586d35c78a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:05.713664 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-261c41ee-9e16-4bd0-87c1-28586d35c78a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:05.714444 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-261c41ee-9e16-4bd0-87c1-28586d35c78a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:05.715425 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-261c41ee-9e16-4bd0-87c1-28586d35c78a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:05.716036 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-261c41ee-9e16-4bd0-87c1-28586d35c78a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:05.855578 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:05.863939 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:05.865744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:05.867252 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5c6d9752-1ed4-46ef-ada2-04d219ffb34a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.242986 Apr 12 16:22:05.868052 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 275/544] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:05 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:05.883480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e087af91-f986-468d-9add-5b336b4183dd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:05.884184 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e087af91-f986-468d-9add-5b336b4183dd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:05.890380 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e087af91-f986-468d-9add-5b336b4183dd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:05.890824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e087af91-f986-468d-9add-5b336b4183dd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:05.891874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e087af91-f986-468d-9add-5b336b4183dd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:05.892553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e087af91-f986-468d-9add-5b336b4183dd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:05.918747 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-261c41ee-9e16-4bd0-87c1-28586d35c78a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:05.927364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-261c41ee-9e16-4bd0-87c1-28586d35c78a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.228950 Apr 12 16:22:05.928246 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 270/545] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:05 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:06.053068 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e087af91-f986-468d-9add-5b336b4183dd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:06.061292 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e087af91-f986-468d-9add-5b336b4183dd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.181591 Apr 12 16:22:06.062214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 276/546] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:05 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:06.889843 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:06.891040 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:06.900109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:06.900558 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:06.901333 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:06.901762 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:06.945666 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6df64b4d-b172-4211-8aa2-77f65f57ff24 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:06.947047 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6df64b4d-b172-4211-8aa2-77f65f57ff24 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:06.954096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6df64b4d-b172-4211-8aa2-77f65f57ff24 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:06.954846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6df64b4d-b172-4211-8aa2-77f65f57ff24 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:06.956148 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6df64b4d-b172-4211-8aa2-77f65f57ff24 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:06.957561 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6df64b4d-b172-4211-8aa2-77f65f57ff24 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:07.183411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:07.201195 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:07.206609 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:07.210149 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-12e75707-3b64-415e-8987-6fc6b15ec63c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.327143 Apr 12 16:22:07.212880 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 271/547] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:06 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:07.222156 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-630f07c1-4cc3-4146-8def-8b2ee6e6121c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:07.223906 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-630f07c1-4cc3-4146-8def-8b2ee6e6121c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:07.240021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-630f07c1-4cc3-4146-8def-8b2ee6e6121c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:07.240843 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-630f07c1-4cc3-4146-8def-8b2ee6e6121c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:07.241844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-630f07c1-4cc3-4146-8def-8b2ee6e6121c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:07.242515 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-630f07c1-4cc3-4146-8def-8b2ee6e6121c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:07.291696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6df64b4d-b172-4211-8aa2-77f65f57ff24 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:07.307231 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6df64b4d-b172-4211-8aa2-77f65f57ff24 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.366183 Apr 12 16:22:07.317455 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 277/548] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:06 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:07.556184 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-630f07c1-4cc3-4146-8def-8b2ee6e6121c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:07.567284 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-630f07c1-4cc3-4146-8def-8b2ee6e6121c tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.351027 Apr 12 16:22:07.568498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 272/549] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:07 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:07.698661 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-8587e144-0f8b-44dc-a93f-0db5933b7a0b req-0d26144f-ddd1-49fb-8683-53ecae0eb1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37fad20-9d1f-4785-ac0d-9babf6466375", "tag": "a9b6c507-f16a-4011-8719-2d8d34825c2a"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:07.710342 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-8587e144-0f8b-44dc-a93f-0db5933b7a0b req-0d26144f-ddd1-49fb-8683-53ecae0eb1c5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:07.710772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-8587e144-0f8b-44dc-a93f-0db5933b7a0b req-0d26144f-ddd1-49fb-8683-53ecae0eb1c5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:07.736203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-8587e144-0f8b-44dc-a93f-0db5933b7a0b req-0d26144f-ddd1-49fb-8683-53ecae0eb1c5 service nova] Creating event network-changed:a9b6c507-f16a-4011-8719-2d8d34825c2a for instance b37fad20-9d1f-4785-ac0d-9babf6466375 on hv-cinder-83752 Apr 12 16:22:07.741543 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-8587e144-0f8b-44dc-a93f-0db5933b7a0b req-0d26144f-ddd1-49fb-8683-53ecae0eb1c5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055202 Apr 12 16:22:07.742174 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 278/550] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:08.230952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:08.231475 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:08.239141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:08.239589 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:08.240355 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:08.240792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:08.329165 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5505948d-c268-43ef-bd63-d9bad5dcffbf tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:08.330555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5505948d-c268-43ef-bd63-d9bad5dcffbf tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:08.338392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5505948d-c268-43ef-bd63-d9bad5dcffbf tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:08.338979 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5505948d-c268-43ef-bd63-d9bad5dcffbf tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:08.339913 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5505948d-c268-43ef-bd63-d9bad5dcffbf tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:08.340446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5505948d-c268-43ef-bd63-d9bad5dcffbf tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:08.374750 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:08.384031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:08.385480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:08.386666 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f42b2520-c4bb-4260-b0f5-fd5706e83c4b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1739 microversion: 2.20 time: 0.161387 Apr 12 16:22:08.387244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 273/551] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:08 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:08.477570 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5505948d-c268-43ef-bd63-d9bad5dcffbf tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:08.486082 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5505948d-c268-43ef-bd63-d9bad5dcffbf tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1708 microversion: 2.1 time: 0.164098 Apr 12 16:22:08.486605 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 279/552] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:08 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:08.587512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1cfe25e9-ecbe-4c02-a5be-a1d0e2cb37ad tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:08.588558 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1cfe25e9-ecbe-4c02-a5be-a1d0e2cb37ad tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:08.595387 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1cfe25e9-ecbe-4c02-a5be-a1d0e2cb37ad tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:08.595840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1cfe25e9-ecbe-4c02-a5be-a1d0e2cb37ad tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:08.596618 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1cfe25e9-ecbe-4c02-a5be-a1d0e2cb37ad tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:08.597290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1cfe25e9-ecbe-4c02-a5be-a1d0e2cb37ad tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:08.740646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1cfe25e9-ecbe-4c02-a5be-a1d0e2cb37ad tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:08.748285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1cfe25e9-ecbe-4c02-a5be-a1d0e2cb37ad tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.167246 Apr 12 16:22:08.749447 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 274/553] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:08 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:09.405763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:09.406343 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:09.413237 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:09.413724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:09.414528 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:09.414966 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:09.502928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a2213e5b-30ec-4bb0-b806-92c6c5dae88d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:09.503881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a2213e5b-30ec-4bb0-b806-92c6c5dae88d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:09.510897 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2213e5b-30ec-4bb0-b806-92c6c5dae88d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:09.511318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2213e5b-30ec-4bb0-b806-92c6c5dae88d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:09.512183 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2213e5b-30ec-4bb0-b806-92c6c5dae88d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:09.512633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2213e5b-30ec-4bb0-b806-92c6c5dae88d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:09.548118 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:09.556649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:09.558188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:09.559357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b938627d-9cd3-4c6d-af44-ec884c515a64 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.157749 Apr 12 16:22:09.559922 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 280/554] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:09 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:09.655159 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a2213e5b-30ec-4bb0-b806-92c6c5dae88d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:09.663989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a2213e5b-30ec-4bb0-b806-92c6c5dae88d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1712 microversion: 2.1 time: 0.164806 Apr 12 16:22:09.664458 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 275/555] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:09 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1712 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:09.767479 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-055aa5c1-ef3e-463c-9d18-aa542a4f3b71 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:09.768095 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-055aa5c1-ef3e-463c-9d18-aa542a4f3b71 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:09.774861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-055aa5c1-ef3e-463c-9d18-aa542a4f3b71 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:09.775318 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-055aa5c1-ef3e-463c-9d18-aa542a4f3b71 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:09.776099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-055aa5c1-ef3e-463c-9d18-aa542a4f3b71 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:09.776540 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-055aa5c1-ef3e-463c-9d18-aa542a4f3b71 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:09.908914 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-055aa5c1-ef3e-463c-9d18-aa542a4f3b71 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:09.917188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-055aa5c1-ef3e-463c-9d18-aa542a4f3b71 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.153495 Apr 12 16:22:09.917737 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 281/556] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:09 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:10.097847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-fdcdc441-4f8d-4ebf-ace7-e5799ed83cb1 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:10.098917 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-fdcdc441-4f8d-4ebf-ace7-e5799ed83cb1 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:10.105291 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fdcdc441-4f8d-4ebf-ace7-e5799ed83cb1 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:10.105749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fdcdc441-4f8d-4ebf-ace7-e5799ed83cb1 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:10.106567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fdcdc441-4f8d-4ebf-ace7-e5799ed83cb1 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:10.107006 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fdcdc441-4f8d-4ebf-ace7-e5799ed83cb1 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:10.180791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-fdcdc441-4f8d-4ebf-ace7-e5799ed83cb1 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "POST /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/action" status: 202 len: 0 microversion: 2.1 time: 0.086730 Apr 12 16:22:10.181346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 276/557] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:22:10 2022] POST /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:22:10.189831 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-484918d5-41ef-4ec5-85f9-4dd9b48fc9b2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:10.190475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-484918d5-41ef-4ec5-85f9-4dd9b48fc9b2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:10.197235 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-484918d5-41ef-4ec5-85f9-4dd9b48fc9b2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:10.197688 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-484918d5-41ef-4ec5-85f9-4dd9b48fc9b2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:10.198537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-484918d5-41ef-4ec5-85f9-4dd9b48fc9b2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:10.198971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-484918d5-41ef-4ec5-85f9-4dd9b48fc9b2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:10.353158 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-484918d5-41ef-4ec5-85f9-4dd9b48fc9b2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:10.361587 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-484918d5-41ef-4ec5-85f9-4dd9b48fc9b2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1750 microversion: 2.1 time: 0.175574 Apr 12 16:22:10.362157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 282/558] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:10 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:10.588063 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:10.588701 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:10.596916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:10.597597 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:10.598905 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:10.599555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:10.730196 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:10.738614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:10.740087 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:10.741242 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8513a57d-4680-421b-89ad-c92e197cbf40 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.158016 Apr 12 16:22:10.741823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 277/559] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:10 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:10.935246 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1c68a691-b40b-45e9-bda1-068191c5fdb7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:10.935815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1c68a691-b40b-45e9-bda1-068191c5fdb7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:10.942981 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1c68a691-b40b-45e9-bda1-068191c5fdb7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:10.943444 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1c68a691-b40b-45e9-bda1-068191c5fdb7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:10.944225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1c68a691-b40b-45e9-bda1-068191c5fdb7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:10.944667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1c68a691-b40b-45e9-bda1-068191c5fdb7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:11.074786 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1c68a691-b40b-45e9-bda1-068191c5fdb7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:11.083398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1c68a691-b40b-45e9-bda1-068191c5fdb7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.152075 Apr 12 16:22:11.083991 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 283/560] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:10 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:11.379651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a8db842e-8025-45e0-9db7-6f5d66e5ec4a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:11.380273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a8db842e-8025-45e0-9db7-6f5d66e5ec4a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:11.386929 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a8db842e-8025-45e0-9db7-6f5d66e5ec4a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:11.387382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a8db842e-8025-45e0-9db7-6f5d66e5ec4a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:11.388167 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a8db842e-8025-45e0-9db7-6f5d66e5ec4a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:11.388605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a8db842e-8025-45e0-9db7-6f5d66e5ec4a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:11.538774 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a8db842e-8025-45e0-9db7-6f5d66e5ec4a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:11.547088 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a8db842e-8025-45e0-9db7-6f5d66e5ec4a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1750 microversion: 2.1 time: 0.171472 Apr 12 16:22:11.547718 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 278/561] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:11 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:11.759461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:11.760076 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:11.767856 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:11.769599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:11.771225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:11.772101 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:11.788560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-fdc01a21-50df-42e2-9e18-9393365079a8 req-ee8f28ca-e784-4ab4-ba5d-dbcb71b67f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f48c36-5e37-4640-b589-df261265d809", "name": "network-vif-unplugged", "status": "completed", "tag": "aaca632c-41bc-43f8-8889-7aea0e458ffa"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:11.798388 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-fdc01a21-50df-42e2-9e18-9393365079a8 req-ee8f28ca-e784-4ab4-ba5d-dbcb71b67f29 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:11.798677 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-fdc01a21-50df-42e2-9e18-9393365079a8 req-ee8f28ca-e784-4ab4-ba5d-dbcb71b67f29 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:11.811140 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-fdc01a21-50df-42e2-9e18-9393365079a8 req-ee8f28ca-e784-4ab4-ba5d-dbcb71b67f29 service nova] Creating event network-vif-unplugged:aaca632c-41bc-43f8-8889-7aea0e458ffa for instance 29f48c36-5e37-4640-b589-df261265d809 on hv-cinder-83752 Apr 12 16:22:11.816587 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-fdc01a21-50df-42e2-9e18-9393365079a8 req-ee8f28ca-e784-4ab4-ba5d-dbcb71b67f29 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031819 Apr 12 16:22:11.817429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 279/562] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:22:11.938776 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:11.947799 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:11.949284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:11.950476 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ffd80133-0c67-49b2-b8d1-46492e2eab88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.194974 Apr 12 16:22:11.951047 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 284/563] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:11 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:12.101794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-05ecb2dc-e591-4e57-be41-8decdc0d2cff tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:12.102522 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-05ecb2dc-e591-4e57-be41-8decdc0d2cff tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:12.109269 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05ecb2dc-e591-4e57-be41-8decdc0d2cff tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:12.109723 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05ecb2dc-e591-4e57-be41-8decdc0d2cff tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:12.110541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05ecb2dc-e591-4e57-be41-8decdc0d2cff tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:12.110980 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05ecb2dc-e591-4e57-be41-8decdc0d2cff tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:12.257302 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-05ecb2dc-e591-4e57-be41-8decdc0d2cff tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:12.265038 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-05ecb2dc-e591-4e57-be41-8decdc0d2cff tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.167814 Apr 12 16:22:12.265603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 280/564] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:12 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:12.564933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4bd7f726-8587-4b54-8630-f73b27f2ec70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:12.565595 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4bd7f726-8587-4b54-8630-f73b27f2ec70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:12.572164 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4bd7f726-8587-4b54-8630-f73b27f2ec70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:12.572601 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4bd7f726-8587-4b54-8630-f73b27f2ec70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:12.573403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4bd7f726-8587-4b54-8630-f73b27f2ec70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:12.573839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4bd7f726-8587-4b54-8630-f73b27f2ec70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:12.724258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4bd7f726-8587-4b54-8630-f73b27f2ec70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:12.732378 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4bd7f726-8587-4b54-8630-f73b27f2ec70 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1750 microversion: 2.1 time: 0.171412 Apr 12 16:22:12.732949 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 285/565] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:12 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:12.969005 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:12.969598 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:12.976656 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:12.977108 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:12.977872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:12.978362 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:13.111772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:13.121423 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:13.122933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:13.124066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-87fca244-53d2-42d9-a746-281638db17e6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.159070 Apr 12 16:22:13.124620 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 281/566] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:12 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:13.283223 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a7c6ee66-c1b4-4821-aae5-02dcdf63135d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:13.283813 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a7c6ee66-c1b4-4821-aae5-02dcdf63135d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:13.290762 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7c6ee66-c1b4-4821-aae5-02dcdf63135d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:13.291209 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7c6ee66-c1b4-4821-aae5-02dcdf63135d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:13.291986 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7c6ee66-c1b4-4821-aae5-02dcdf63135d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:13.292415 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7c6ee66-c1b4-4821-aae5-02dcdf63135d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:13.429719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a7c6ee66-c1b4-4821-aae5-02dcdf63135d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:13.438271 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a7c6ee66-c1b4-4821-aae5-02dcdf63135d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.158963 Apr 12 16:22:13.438861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 286/567] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:13 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:13.750800 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9c7202dd-1243-4001-bfa4-ab9aa3b4c120 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:13.751551 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9c7202dd-1243-4001-bfa4-ab9aa3b4c120 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:13.758094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9c7202dd-1243-4001-bfa4-ab9aa3b4c120 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:13.758577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9c7202dd-1243-4001-bfa4-ab9aa3b4c120 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:13.759366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9c7202dd-1243-4001-bfa4-ab9aa3b4c120 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:13.759789 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9c7202dd-1243-4001-bfa4-ab9aa3b4c120 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:14.145792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:14.146566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:14.153493 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:14.153957 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:14.154767 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:14.155197 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:14.527667 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9c7202dd-1243-4001-bfa4-ab9aa3b4c120 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:14.537244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9c7202dd-1243-4001-bfa4-ab9aa3b4c120 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1750 microversion: 2.1 time: 0.790674 Apr 12 16:22:14.537994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 282/568] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:13 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1750 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:14.551370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:14.555822 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f80abb5e-b094-41ca-9989-c9e9d573958a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:14.556523 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f80abb5e-b094-41ca-9989-c9e9d573958a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:14.560364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:14.561967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:14.563223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f80abb5e-b094-41ca-9989-c9e9d573958a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:14.563421 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a7621008-4879-4977-af12-fff5f89955a4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.422251 Apr 12 16:22:14.563801 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f80abb5e-b094-41ca-9989-c9e9d573958a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:14.563961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 287/569] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:14 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:14.564924 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f80abb5e-b094-41ca-9989-c9e9d573958a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:14.565434 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f80abb5e-b094-41ca-9989-c9e9d573958a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:14.752477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f80abb5e-b094-41ca-9989-c9e9d573958a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:14.760777 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f80abb5e-b094-41ca-9989-c9e9d573958a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.209651 Apr 12 16:22:14.761351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 283/570] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:14 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:15.556577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dbae79da-1f4e-4506-aa1d-2576b255e831 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:15.557203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dbae79da-1f4e-4506-aa1d-2576b255e831 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:15.563651 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dbae79da-1f4e-4506-aa1d-2576b255e831 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:15.564099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dbae79da-1f4e-4506-aa1d-2576b255e831 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:15.564866 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dbae79da-1f4e-4506-aa1d-2576b255e831 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:15.565298 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dbae79da-1f4e-4506-aa1d-2576b255e831 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:15.583158 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:15.583906 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:15.590281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:15.590750 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:15.591521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:15.591940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:15.779796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dbae79da-1f4e-4506-aa1d-2576b255e831 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:15.783247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:15.791978 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dbae79da-1f4e-4506-aa1d-2576b255e831 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1750 microversion: 2.1 time: 0.237698 Apr 12 16:22:15.792212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:15.793427 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 288/571] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:15 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1750 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:15.793584 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:15.794932 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-63ea15d6-685b-4dde-846a-8569fb41919e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.216762 Apr 12 16:22:15.795515 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 284/572] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:15 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:15.802654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ab6249d7-3dd2-4f90-9513-b68aeb8acb58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:15.803407 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ab6249d7-3dd2-4f90-9513-b68aeb8acb58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:15.810364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab6249d7-3dd2-4f90-9513-b68aeb8acb58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:15.810874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab6249d7-3dd2-4f90-9513-b68aeb8acb58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:15.811779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab6249d7-3dd2-4f90-9513-b68aeb8acb58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:15.812419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab6249d7-3dd2-4f90-9513-b68aeb8acb58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:15.957213 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ab6249d7-3dd2-4f90-9513-b68aeb8acb58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:15.965013 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ab6249d7-3dd2-4f90-9513-b68aeb8acb58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.168014 Apr 12 16:22:15.965602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 289/573] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:15 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:16.813695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-72ac3235-2e94-465a-a585-6100eb6eba8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:16.814695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-72ac3235-2e94-465a-a585-6100eb6eba8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:16.816667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:16.817646 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:16.824167 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-72ac3235-2e94-465a-a585-6100eb6eba8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:16.824678 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-72ac3235-2e94-465a-a585-6100eb6eba8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:16.825702 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-72ac3235-2e94-465a-a585-6100eb6eba8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:16.826070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:16.826361 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-72ac3235-2e94-465a-a585-6100eb6eba8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:16.826589 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:16.827406 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:16.828057 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:17.044194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:17.049155 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-72ac3235-2e94-465a-a585-6100eb6eba8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:17.054921 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:17.056409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:17.057832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8b015f20-abcf-48fb-9f16-5383d2df442d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.247916 Apr 12 16:22:17.058289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-72ac3235-2e94-465a-a585-6100eb6eba8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1750 microversion: 2.1 time: 0.251365 Apr 12 16:22:17.058886 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 285/574] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:16 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1750 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:17.063832 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b4830ff1-8d6a-40e0-9d5a-76b07d738872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:17.064646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b4830ff1-8d6a-40e0-9d5a-76b07d738872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:17.069511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 290/575] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:16 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:17.072425 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b4830ff1-8d6a-40e0-9d5a-76b07d738872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:17.072884 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b4830ff1-8d6a-40e0-9d5a-76b07d738872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:17.073672 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b4830ff1-8d6a-40e0-9d5a-76b07d738872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:17.074103 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b4830ff1-8d6a-40e0-9d5a-76b07d738872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:17.326217 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9889056e-fd5a-4881-bef5-9e1864774ca6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:17.327030 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9889056e-fd5a-4881-bef5-9e1864774ca6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:17.336344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9889056e-fd5a-4881-bef5-9e1864774ca6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:17.337512 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9889056e-fd5a-4881-bef5-9e1864774ca6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:17.339198 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9889056e-fd5a-4881-bef5-9e1864774ca6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:17.340200 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9889056e-fd5a-4881-bef5-9e1864774ca6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:17.351970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b4830ff1-8d6a-40e0-9d5a-76b07d738872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:17.360882 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b4830ff1-8d6a-40e0-9d5a-76b07d738872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.300826 Apr 12 16:22:17.362166 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 286/576] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:17 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:17.557733 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-9889056e-fd5a-4881-bef5-9e1864774ca6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lazy-loading 'services' on Instance uuid 8ccc877e-8add-4637-87ca-3d598180f495 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:22:17.683449 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9889056e-fd5a-4881-bef5-9e1864774ca6 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495/os-volume_attachments/c0645c88-d0eb-4cfe-8f84-3a757fedf232" status: 202 len: 0 microversion: 2.1 time: 0.361408 Apr 12 16:22:17.684221 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 291/577] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:22:17 2022] DELETE /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495/os-volume_attachments/c0645c88-d0eb-4cfe-8f84-3a757fedf232 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:22:18.077575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:18.078601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:18.081850 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ab36940c-5f2c-4bd5-a031-bf7eb2f0220b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:18.082773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ab36940c-5f2c-4bd5-a031-bf7eb2f0220b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:18.086846 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:18.087288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:18.088109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:18.088567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:18.089868 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab36940c-5f2c-4bd5-a031-bf7eb2f0220b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:18.090484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab36940c-5f2c-4bd5-a031-bf7eb2f0220b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:18.091283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab36940c-5f2c-4bd5-a031-bf7eb2f0220b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:18.091721 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab36940c-5f2c-4bd5-a031-bf7eb2f0220b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:18.300773 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:18.305421 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ab36940c-5f2c-4bd5-a031-bf7eb2f0220b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:18.309819 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:18.311560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:18.313015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c2f99804-f3f8-4215-a6e9-d0e199da5f56 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.239727 Apr 12 16:22:18.313737 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 287/578] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:18 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:18.314820 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ab36940c-5f2c-4bd5-a031-bf7eb2f0220b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.237754 Apr 12 16:22:18.315639 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 292/579] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:18 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:18.385761 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-512d4298-32e2-4a57-9d87-f64797c3b525 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:18.386312 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-512d4298-32e2-4a57-9d87-f64797c3b525 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:18.392632 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-512d4298-32e2-4a57-9d87-f64797c3b525 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:18.393093 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-512d4298-32e2-4a57-9d87-f64797c3b525 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:18.393931 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-512d4298-32e2-4a57-9d87-f64797c3b525 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:18.394412 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-512d4298-32e2-4a57-9d87-f64797c3b525 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:18.530571 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-512d4298-32e2-4a57-9d87-f64797c3b525 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:18.538779 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-512d4298-32e2-4a57-9d87-f64797c3b525 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.156987 Apr 12 16:22:18.539372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 288/580] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:18 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:19.336484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:19.337085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:19.337381 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-85046f93-813b-469d-b73d-5c505c388c8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:19.338628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-85046f93-813b-469d-b73d-5c505c388c8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:19.344616 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:19.345081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:19.345601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85046f93-813b-469d-b73d-5c505c388c8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:19.345879 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:19.346020 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85046f93-813b-469d-b73d-5c505c388c8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:19.346367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:19.346997 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85046f93-813b-469d-b73d-5c505c388c8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:19.347498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85046f93-813b-469d-b73d-5c505c388c8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:19.554320 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:19.560311 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-85046f93-813b-469d-b73d-5c505c388c8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:19.562846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:19.564344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:19.565702 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9a0c6159-e0e8-4042-8d8b-e0a4bbb4af29 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.234036 Apr 12 16:22:19.566487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 293/581] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:19 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:19.570958 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1e878fd6-f991-42c3-93ad-f7daa73094c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:19.571276 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-85046f93-813b-469d-b73d-5c505c388c8c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.237586 Apr 12 16:22:19.571574 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1e878fd6-f991-42c3-93ad-f7daa73094c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:19.572460 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 289/582] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:19 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:19.578166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e878fd6-f991-42c3-93ad-f7daa73094c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:19.578980 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e878fd6-f991-42c3-93ad-f7daa73094c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:19.580566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e878fd6-f991-42c3-93ad-f7daa73094c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:19.581287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1e878fd6-f991-42c3-93ad-f7daa73094c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:19.741667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1e878fd6-f991-42c3-93ad-f7daa73094c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:19.749419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1e878fd6-f991-42c3-93ad-f7daa73094c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.181949 Apr 12 16:22:19.750001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 294/583] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:19 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:20.310599 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-7271402e-7e98-471d-9f45-2dc5c18029e9 req-8161b8ab-1c59-424c-b251-702b747c321b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37fad20-9d1f-4785-ac0d-9babf6466375", "name": "network-vif-plugged", "status": "completed", "tag": "a9b6c507-f16a-4011-8719-2d8d34825c2a"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:20.319621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-7271402e-7e98-471d-9f45-2dc5c18029e9 req-8161b8ab-1c59-424c-b251-702b747c321b service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:20.320078 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-7271402e-7e98-471d-9f45-2dc5c18029e9 req-8161b8ab-1c59-424c-b251-702b747c321b service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:20.334374 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-7271402e-7e98-471d-9f45-2dc5c18029e9 req-8161b8ab-1c59-424c-b251-702b747c321b service nova] Creating event network-vif-plugged:a9b6c507-f16a-4011-8719-2d8d34825c2a for instance b37fad20-9d1f-4785-ac0d-9babf6466375 on hv-cinder-83752 Apr 12 16:22:20.339582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-7271402e-7e98-471d-9f45-2dc5c18029e9 req-8161b8ab-1c59-424c-b251-702b747c321b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032726 Apr 12 16:22:20.340480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 290/584] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:20.588053 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:20.588724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:20.591490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7786d25c-35e7-4b62-9278-fd16bde819d2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:20.592188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7786d25c-35e7-4b62-9278-fd16bde819d2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:20.595513 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:20.595965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:20.596984 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:20.597417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:20.599346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7786d25c-35e7-4b62-9278-fd16bde819d2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:20.599797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7786d25c-35e7-4b62-9278-fd16bde819d2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:20.600575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7786d25c-35e7-4b62-9278-fd16bde819d2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:20.601011 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7786d25c-35e7-4b62-9278-fd16bde819d2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:20.803504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:20.812662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:20.814150 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:20.816195 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bf4f5710-7770-47da-a94b-4548095b1d45 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.231481 Apr 12 16:22:20.816777 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 295/585] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:20 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:20.817445 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-7786d25c-35e7-4b62-9278-fd16bde819d2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:20.824664 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d9a48b33-0d07-4de1-a40d-6605734ace88 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:20.826123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d9a48b33-0d07-4de1-a40d-6605734ace88 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:20.826491 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7786d25c-35e7-4b62-9278-fd16bde819d2 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.239059 Apr 12 16:22:20.827087 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 291/586] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:20 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:20.833480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9a48b33-0d07-4de1-a40d-6605734ace88 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:20.834010 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9a48b33-0d07-4de1-a40d-6605734ace88 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:20.834892 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9a48b33-0d07-4de1-a40d-6605734ace88 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:20.835398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9a48b33-0d07-4de1-a40d-6605734ace88 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:21.026944 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d9a48b33-0d07-4de1-a40d-6605734ace88 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:21.037863 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d9a48b33-0d07-4de1-a40d-6605734ace88 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.218633 Apr 12 16:22:21.038839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 296/587] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:20 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:21.851445 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:21.852429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:21.859518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5fb686fe-dbd2-4d96-9172-26d096730f34 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:21.861619 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5fb686fe-dbd2-4d96-9172-26d096730f34 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:21.867770 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:21.868229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:21.869033 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:21.869641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:21.872432 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5fb686fe-dbd2-4d96-9172-26d096730f34 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:21.873038 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5fb686fe-dbd2-4d96-9172-26d096730f34 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:21.874281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5fb686fe-dbd2-4d96-9172-26d096730f34 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:21.874895 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5fb686fe-dbd2-4d96-9172-26d096730f34 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:22.488735 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5fb686fe-dbd2-4d96-9172-26d096730f34 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:22.492839 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:22.500120 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5fb686fe-dbd2-4d96-9172-26d096730f34 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.646411 Apr 12 16:22:22.501143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 297/588] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:21 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:22.516110 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:22.516479 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7574bea7-a014-490b-8ddc-4eb6cfe3d8b4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:22.516945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7574bea7-a014-490b-8ddc-4eb6cfe3d8b4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:22.518745 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:22.520454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d804d07b-fdcc-4f39-9291-db8e661f89ef tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1721 microversion: 2.20 time: 0.677801 Apr 12 16:22:22.524669 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7574bea7-a014-490b-8ddc-4eb6cfe3d8b4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:22.525399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7574bea7-a014-490b-8ddc-4eb6cfe3d8b4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:22.526472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7574bea7-a014-490b-8ddc-4eb6cfe3d8b4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:22.526914 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7574bea7-a014-490b-8ddc-4eb6cfe3d8b4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:22.533521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 292/589] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:21 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1721 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:22.660159 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7574bea7-a014-490b-8ddc-4eb6cfe3d8b4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:22.667774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7574bea7-a014-490b-8ddc-4eb6cfe3d8b4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.165484 Apr 12 16:22:22.668357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 298/590] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:22 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:23.521378 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d771d347-14b3-4e78-8e37-8d84470c7d0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:23.522155 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d771d347-14b3-4e78-8e37-8d84470c7d0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:23.529286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d771d347-14b3-4e78-8e37-8d84470c7d0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:23.529808 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d771d347-14b3-4e78-8e37-8d84470c7d0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:23.530735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d771d347-14b3-4e78-8e37-8d84470c7d0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:23.531297 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d771d347-14b3-4e78-8e37-8d84470c7d0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:23.543081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:23.543894 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:23.551868 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:23.552602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:23.554163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:23.554706 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:23.760086 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d771d347-14b3-4e78-8e37-8d84470c7d0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:23.763786 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:23.768888 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d771d347-14b3-4e78-8e37-8d84470c7d0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.252051 Apr 12 16:22:23.769793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 293/591] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:23 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:23.773601 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:23.774400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-81366a34-01cd-460b-a298-521ce0487b92 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:23.774973 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-81366a34-01cd-460b-a298-521ce0487b92 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:23.775698 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:23.777219 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-874993bb-a454-4706-856b-57e1758f57d8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1664 microversion: 2.20 time: 0.238445 Apr 12 16:22:23.777906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 299/592] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:23 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1664 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:23.780863 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-81366a34-01cd-460b-a298-521ce0487b92 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:23.781308 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-81366a34-01cd-460b-a298-521ce0487b92 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:23.782081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-81366a34-01cd-460b-a298-521ce0487b92 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:23.782516 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-81366a34-01cd-460b-a298-521ce0487b92 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:23.798704 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d4cdb480-ad2d-412f-b267-07da6c2bc47b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "060d8aec-57e3-4413-8f96-e837ca65d878"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:23.801723 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d4cdb480-ad2d-412f-b267-07da6c2bc47b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:23.811865 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d4cdb480-ad2d-412f-b267-07da6c2bc47b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:23.812658 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d4cdb480-ad2d-412f-b267-07da6c2bc47b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:23.814068 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d4cdb480-ad2d-412f-b267-07da6c2bc47b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:23.814820 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d4cdb480-ad2d-412f-b267-07da6c2bc47b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:23.938507 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-81366a34-01cd-460b-a298-521ce0487b92 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:23.947092 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-81366a34-01cd-460b-a298-521ce0487b92 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.176332 Apr 12 16:22:23.947936 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 294/593] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:23 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:24.149719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d4cdb480-ad2d-412f-b267-07da6c2bc47b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.357422 Apr 12 16:22:24.150137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1cb4e9c4-9e49-4986-9857-ef93a708e46c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:24.150950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1cb4e9c4-9e49-4986-9857-ef93a708e46c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:24.151065 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 300/594] 10.222.0.67 () {62 vars in 1363 bytes} [Tue Apr 12 16:22:23 2022] POST /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments => generated 188 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 16:22:24.157012 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1cb4e9c4-9e49-4986-9857-ef93a708e46c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.157460 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1cb4e9c4-9e49-4986-9857-ef93a708e46c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.158292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1cb4e9c4-9e49-4986-9857-ef93a708e46c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.158753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1cb4e9c4-9e49-4986-9857-ef93a708e46c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.200110 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1cb4e9c4-9e49-4986-9857-ef93a708e46c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Going to try to terminate instance {{(pid=117201) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:22:24.279661 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9fb3768a-cf6c-40ab-b8a3-973dd2cbe6f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:24.280365 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9fb3768a-cf6c-40ab-b8a3-973dd2cbe6f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:24.288181 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fb3768a-cf6c-40ab-b8a3-973dd2cbe6f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.288753 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fb3768a-cf6c-40ab-b8a3-973dd2cbe6f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.289765 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fb3768a-cf6c-40ab-b8a3-973dd2cbe6f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.290341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fb3768a-cf6c-40ab-b8a3-973dd2cbe6f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.295963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1cb4e9c4-9e49-4986-9857-ef93a708e46c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 204 len: 0 microversion: 2.1 time: 0.148964 Apr 12 16:22:24.295963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 295/595] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:22:24 2022] DELETE /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:22:24.304698 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-aa5a387b-9705-4444-89c5-463713ac52c7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:24.305395 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-aa5a387b-9705-4444-89c5-463713ac52c7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:24.311510 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa5a387b-9705-4444-89c5-463713ac52c7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.311861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa5a387b-9705-4444-89c5-463713ac52c7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.312670 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa5a387b-9705-4444-89c5-463713ac52c7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.313110 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa5a387b-9705-4444-89c5-463713ac52c7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.385401 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9fb3768a-cf6c-40ab-b8a3-973dd2cbe6f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/action" status: 202 len: 0 microversion: 2.20 time: 0.110692 Apr 12 16:22:24.386254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 301/596] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Apr 12 16:22:24 2022] POST /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:22:24.394356 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:24.395146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:24.402108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.402108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.402551 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.402890 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.505490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aa5a387b-9705-4444-89c5-463713ac52c7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:24.518606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-aa5a387b-9705-4444-89c5-463713ac52c7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1558 microversion: 2.1 time: 0.217561 Apr 12 16:22:24.519633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 296/597] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:24 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:24.577079 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:24.587805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:24.589367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:24.590538 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0315ad5c-7288-4953-a496-e1a107f70c0c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1750 microversion: 2.20 time: 0.200212 Apr 12 16:22:24.591096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 302/598] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:24 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1750 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:24.794850 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a6894baf-db11-4a14-b372-2c1066d84494 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:24.795577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a6894baf-db11-4a14-b372-2c1066d84494 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:24.803060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a6894baf-db11-4a14-b372-2c1066d84494 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.803623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a6894baf-db11-4a14-b372-2c1066d84494 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.804706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a6894baf-db11-4a14-b372-2c1066d84494 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.805177 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a6894baf-db11-4a14-b372-2c1066d84494 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.958530 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a6894baf-db11-4a14-b372-2c1066d84494 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:24.968935 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3113f7ce-2190-4c50-b905-2ac127370bc2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:24.969965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3113f7ce-2190-4c50-b905-2ac127370bc2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:24.972096 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a6894baf-db11-4a14-b372-2c1066d84494 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.180927 Apr 12 16:22:24.974318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 297/599] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:24 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:24.979389 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3113f7ce-2190-4c50-b905-2ac127370bc2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.980162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3113f7ce-2190-4c50-b905-2ac127370bc2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:24.981531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3113f7ce-2190-4c50-b905-2ac127370bc2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:24.982577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3113f7ce-2190-4c50-b905-2ac127370bc2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:25.172756 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3113f7ce-2190-4c50-b905-2ac127370bc2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:25.181336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3113f7ce-2190-4c50-b905-2ac127370bc2 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.219096 Apr 12 16:22:25.182032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 303/600] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:24 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:25.537222 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2c9d2d54-0d5e-4d2e-b4b9-efb3c01499a7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:25.537867 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2c9d2d54-0d5e-4d2e-b4b9-efb3c01499a7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:25.544151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2c9d2d54-0d5e-4d2e-b4b9-efb3c01499a7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:25.544606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2c9d2d54-0d5e-4d2e-b4b9-efb3c01499a7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:25.545382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2c9d2d54-0d5e-4d2e-b4b9-efb3c01499a7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:25.545818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2c9d2d54-0d5e-4d2e-b4b9-efb3c01499a7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:25.613899 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:25.615037 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:25.624228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:25.625008 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:25.626443 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:25.627217 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:25.717260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2c9d2d54-0d5e-4d2e-b4b9-efb3c01499a7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:25.724996 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2c9d2d54-0d5e-4d2e-b4b9-efb3c01499a7 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1512 microversion: 2.1 time: 0.192091 Apr 12 16:22:25.725574 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 298/601] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:25 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:25.781054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:25.790480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:25.791961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:25.793114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0291f794-f314-4c1f-9a79-6d591917e5db tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1750 microversion: 2.20 time: 0.186357 Apr 12 16:22:25.793671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 304/602] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:25 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:25.990858 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d15960e3-b604-4be4-9be4-6b6464d5eef5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:25.991407 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d15960e3-b604-4be4-9be4-6b6464d5eef5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:25.998642 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d15960e3-b604-4be4-9be4-6b6464d5eef5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:25.999098 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d15960e3-b604-4be4-9be4-6b6464d5eef5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:25.999879 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d15960e3-b604-4be4-9be4-6b6464d5eef5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:26.000316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d15960e3-b604-4be4-9be4-6b6464d5eef5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:26.145508 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d15960e3-b604-4be4-9be4-6b6464d5eef5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:26.153804 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d15960e3-b604-4be4-9be4-6b6464d5eef5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.167450 Apr 12 16:22:26.154527 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 299/603] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:25 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:26.199917 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-47b69c5b-635e-4ab4-bb4e-3d1f95462319 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:26.200505 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-47b69c5b-635e-4ab4-bb4e-3d1f95462319 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:26.207522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-47b69c5b-635e-4ab4-bb4e-3d1f95462319 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:26.207982 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-47b69c5b-635e-4ab4-bb4e-3d1f95462319 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:26.209085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-47b69c5b-635e-4ab4-bb4e-3d1f95462319 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:26.209558 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-47b69c5b-635e-4ab4-bb4e-3d1f95462319 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:26.344272 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-47b69c5b-635e-4ab4-bb4e-3d1f95462319 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:26.352094 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-47b69c5b-635e-4ab4-bb4e-3d1f95462319 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.156109 Apr 12 16:22:26.352685 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 305/604] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:26 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:26.742957 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6023245c-47c8-419a-80cf-51eaddb6314b tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:26.743562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6023245c-47c8-419a-80cf-51eaddb6314b tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:26.750004 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6023245c-47c8-419a-80cf-51eaddb6314b tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:26.750477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6023245c-47c8-419a-80cf-51eaddb6314b tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:26.751239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6023245c-47c8-419a-80cf-51eaddb6314b tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:26.751672 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6023245c-47c8-419a-80cf-51eaddb6314b tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:26.812356 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:26.813047 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:26.819676 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:26.820130 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:26.820912 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:26.821352 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:26.914705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6023245c-47c8-419a-80cf-51eaddb6314b tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:26.922623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6023245c-47c8-419a-80cf-51eaddb6314b tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1512 microversion: 2.1 time: 0.183469 Apr 12 16:22:26.923175 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 300/605] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:26 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:26.972231 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:26.980996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:26.982513 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:26.983677 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-401de552-68aa-46d9-a226-09997b526f22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1750 microversion: 2.20 time: 0.175315 Apr 12 16:22:26.984237 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 306/606] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:26 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:27.171780 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9be0504b-3d83-4efe-a6a5-c0369de71137 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:27.172420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9be0504b-3d83-4efe-a6a5-c0369de71137 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:27.179414 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9be0504b-3d83-4efe-a6a5-c0369de71137 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:27.179885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9be0504b-3d83-4efe-a6a5-c0369de71137 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:27.180627 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9be0504b-3d83-4efe-a6a5-c0369de71137 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:27.181057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9be0504b-3d83-4efe-a6a5-c0369de71137 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:27.327406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9be0504b-3d83-4efe-a6a5-c0369de71137 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:27.336121 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9be0504b-3d83-4efe-a6a5-c0369de71137 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.168265 Apr 12 16:22:27.336705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 301/607] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:27 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:27.368803 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e3d6e43d-e9c6-42c3-a131-386924647c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:27.369405 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e3d6e43d-e9c6-42c3-a131-386924647c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:27.375773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3d6e43d-e9c6-42c3-a131-386924647c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:27.376224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3d6e43d-e9c6-42c3-a131-386924647c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:27.376979 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3d6e43d-e9c6-42c3-a131-386924647c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:27.377405 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e3d6e43d-e9c6-42c3-a131-386924647c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:27.509249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e3d6e43d-e9c6-42c3-a131-386924647c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:27.516726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e3d6e43d-e9c6-42c3-a131-386924647c75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1372 microversion: 2.1 time: 0.151807 Apr 12 16:22:27.517294 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 307/608] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:27 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:27.940555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a9bfd0d2-d280-4350-95fd-38716ff44606 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:27.941169 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a9bfd0d2-d280-4350-95fd-38716ff44606 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:27.947681 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a9bfd0d2-d280-4350-95fd-38716ff44606 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:27.948131 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a9bfd0d2-d280-4350-95fd-38716ff44606 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:27.948902 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a9bfd0d2-d280-4350-95fd-38716ff44606 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:27.949332 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a9bfd0d2-d280-4350-95fd-38716ff44606 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.002414 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:28.003065 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:28.009643 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:28.010143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.012844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:28.013863 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.129422 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a9bfd0d2-d280-4350-95fd-38716ff44606 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:28.133820 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a9bfd0d2-d280-4350-95fd-38716ff44606 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1512 microversion: 2.1 time: 0.197327 Apr 12 16:22:28.134635 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 302/609] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:27 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:28.170927 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:28.179508 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:28.181025 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:28.182256 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7b81ac2d-e316-43c6-b5d2-2d9441ac8c90 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1750 microversion: 2.20 time: 0.183862 Apr 12 16:22:28.182795 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 308/610] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:27 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:28.353314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4e3768a8-5ba2-44c6-be1c-fc4e72faefe7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:28.353932 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4e3768a8-5ba2-44c6-be1c-fc4e72faefe7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:28.360524 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4e3768a8-5ba2-44c6-be1c-fc4e72faefe7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:28.360978 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4e3768a8-5ba2-44c6-be1c-fc4e72faefe7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.361750 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4e3768a8-5ba2-44c6-be1c-fc4e72faefe7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:28.362640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4e3768a8-5ba2-44c6-be1c-fc4e72faefe7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.509872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4e3768a8-5ba2-44c6-be1c-fc4e72faefe7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:28.518415 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4e3768a8-5ba2-44c6-be1c-fc4e72faefe7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.169039 Apr 12 16:22:28.519105 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 303/611] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:28 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:28.534230 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2d3850fb-c329-41ae-965d-7efac2d54607 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:28.534849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2d3850fb-c329-41ae-965d-7efac2d54607 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:28.541289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2d3850fb-c329-41ae-965d-7efac2d54607 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:28.541740 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2d3850fb-c329-41ae-965d-7efac2d54607 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.542561 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2d3850fb-c329-41ae-965d-7efac2d54607 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:28.543018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2d3850fb-c329-41ae-965d-7efac2d54607 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.673567 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2d3850fb-c329-41ae-965d-7efac2d54607 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:28.681714 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2d3850fb-c329-41ae-965d-7efac2d54607 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1565 microversion: 2.1 time: 0.151686 Apr 12 16:22:28.682302 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 309/612] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:28 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:28.698405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-da5bb2f4-02f5-4cb6-9727-858ae1e5c255 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:28.698922 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-da5bb2f4-02f5-4cb6-9727-858ae1e5c255 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:28.705589 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da5bb2f4-02f5-4cb6-9727-858ae1e5c255 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:28.706164 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da5bb2f4-02f5-4cb6-9727-858ae1e5c255 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.707041 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da5bb2f4-02f5-4cb6-9727-858ae1e5c255 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:28.707469 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-da5bb2f4-02f5-4cb6-9727-858ae1e5c255 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:28.791245 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-da5bb2f4-02f5-4cb6-9727-858ae1e5c255 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096686 Apr 12 16:22:28.791849 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 304/613] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Apr 12 16:22:28 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:29.151423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-355ceb23-8a91-48d6-a82c-536cd8776b91 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:29.152228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-355ceb23-8a91-48d6-a82c-536cd8776b91 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:29.159237 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-355ceb23-8a91-48d6-a82c-536cd8776b91 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:29.159964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-355ceb23-8a91-48d6-a82c-536cd8776b91 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:29.160730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-355ceb23-8a91-48d6-a82c-536cd8776b91 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:29.161188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-355ceb23-8a91-48d6-a82c-536cd8776b91 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:29.201041 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:29.201673 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:29.208646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:29.209106 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:29.209893 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:29.210859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:29.446885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-355ceb23-8a91-48d6-a82c-536cd8776b91 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:29.454637 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-355ceb23-8a91-48d6-a82c-536cd8776b91 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1512 microversion: 2.1 time: 0.307030 Apr 12 16:22:29.455548 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 310/614] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:29 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:29.514157 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:29.523492 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:29.525092 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:29.526371 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-45020e17-ccff-4169-98c5-a8dbddd7fbee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1752 microversion: 2.20 time: 0.329570 Apr 12 16:22:29.526931 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 305/615] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:29 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1752 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:29.536213 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c86eb145-ae04-4762-9d6c-11a61a5b5aca tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:29.536848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c86eb145-ae04-4762-9d6c-11a61a5b5aca tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:29.543318 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c86eb145-ae04-4762-9d6c-11a61a5b5aca tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:29.543767 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c86eb145-ae04-4762-9d6c-11a61a5b5aca tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:29.544544 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c86eb145-ae04-4762-9d6c-11a61a5b5aca tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:29.544975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c86eb145-ae04-4762-9d6c-11a61a5b5aca tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:29.809390 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c86eb145-ae04-4762-9d6c-11a61a5b5aca tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:29.824842 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c86eb145-ae04-4762-9d6c-11a61a5b5aca tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.292911 Apr 12 16:22:29.830848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 311/616] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:29 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:30.472559 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3474abfb-3155-41f0-b8d9-1042060723b3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:30.473192 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3474abfb-3155-41f0-b8d9-1042060723b3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:30.480127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3474abfb-3155-41f0-b8d9-1042060723b3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:30.480569 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3474abfb-3155-41f0-b8d9-1042060723b3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:30.481340 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3474abfb-3155-41f0-b8d9-1042060723b3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:30.481766 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3474abfb-3155-41f0-b8d9-1042060723b3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:30.545185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:30.546006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:30.553396 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:30.553950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:30.554839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:30.555345 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:30.900405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3474abfb-3155-41f0-b8d9-1042060723b3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:30.909407 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3474abfb-3155-41f0-b8d9-1042060723b3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1512 microversion: 2.1 time: 0.440524 Apr 12 16:22:30.910432 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 306/617] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:30 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:30.916873 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-10e6003b-eb61-4117-a3dc-cf2883600fbf req-93495abc-3668-410b-bc60-9533c5701483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37fad20-9d1f-4785-ac0d-9babf6466375", "tag": "a9b6c507-f16a-4011-8719-2d8d34825c2a"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:30.928280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-10e6003b-eb61-4117-a3dc-cf2883600fbf req-93495abc-3668-410b-bc60-9533c5701483 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:30.929066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-10e6003b-eb61-4117-a3dc-cf2883600fbf req-93495abc-3668-410b-bc60-9533c5701483 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:30.944660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-10e6003b-eb61-4117-a3dc-cf2883600fbf req-93495abc-3668-410b-bc60-9533c5701483 service nova] Creating event network-changed:a9b6c507-f16a-4011-8719-2d8d34825c2a for instance b37fad20-9d1f-4785-ac0d-9babf6466375 on hv-cinder-83752 Apr 12 16:22:30.946962 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:30.950077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-10e6003b-eb61-4117-a3dc-cf2883600fbf req-93495abc-3668-410b-bc60-9533c5701483 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038184 Apr 12 16:22:30.950911 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 307/618] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:30.956513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-28bd4761-3bc7-4ed6-8066-414e7f498d1e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:30.957351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-28bd4761-3bc7-4ed6-8066-414e7f498d1e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:30.960403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:30.962014 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:30.963236 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ebc5b0d1-37e9-48c6-be0a-ebca35b4f195 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1752 microversion: 2.20 time: 0.422304 Apr 12 16:22:30.963796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 312/619] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:30 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1752 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:30.964988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-28bd4761-3bc7-4ed6-8066-414e7f498d1e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:30.965497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-28bd4761-3bc7-4ed6-8066-414e7f498d1e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:30.966388 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-28bd4761-3bc7-4ed6-8066-414e7f498d1e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:30.966878 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-28bd4761-3bc7-4ed6-8066-414e7f498d1e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:31.255814 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-28bd4761-3bc7-4ed6-8066-414e7f498d1e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:31.263732 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-28bd4761-3bc7-4ed6-8066-414e7f498d1e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.311516 Apr 12 16:22:31.264338 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 308/620] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:30 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:31.931487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:31.932073 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:31.941396 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:31.941838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:31.942673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:31.943283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:31.973903 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:31.975590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:31.975590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lazy-loading 'fault' on Instance uuid 8ccc877e-8add-4637-87ca-3d598180f495 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:22:31.980737 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:31.981342 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:31.991678 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:31.992171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:31.992941 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:31.993369 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:32.016861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:32.025762 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4950e8fb-b99b-478b-bf59-ef6721ce14a3 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 200 len: 1309 microversion: 2.1 time: 0.100456 Apr 12 16:22:32.026406 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 313/621] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:31 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:32.129179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:32.140334 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:32.142687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:32.144289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-fa831f44-0f80-47b4-9d37-da1cea1ef24a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.167347 Apr 12 16:22:32.145032 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 309/622] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:31 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:32.286504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-83650e22-940d-4e08-941a-c73038b337ef tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:32.287571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-83650e22-940d-4e08-941a-c73038b337ef tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:32.297950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-83650e22-940d-4e08-941a-c73038b337ef tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:32.298766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-83650e22-940d-4e08-941a-c73038b337ef tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:32.299947 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-83650e22-940d-4e08-941a-c73038b337ef tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:32.300411 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-83650e22-940d-4e08-941a-c73038b337ef tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:32.701833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-83650e22-940d-4e08-941a-c73038b337ef tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:32.711131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-83650e22-940d-4e08-941a-c73038b337ef tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.431267 Apr 12 16:22:32.711753 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 314/623] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:32 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:32.999834 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-688eb42d-5756-4656-8da7-652a8534236d req-effbe6b7-dbb7-43c2-a635-60cbeceb2c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccc877e-8add-4637-87ca-3d598180f495", "name": "network-vif-deleted", "tag": "964b26c8-87b2-4c98-a446-64b394850524"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:33.008585 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-688eb42d-5756-4656-8da7-652a8534236d req-effbe6b7-dbb7-43c2-a635-60cbeceb2c87 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:33.009040 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-688eb42d-5756-4656-8da7-652a8534236d req-effbe6b7-dbb7-43c2-a635-60cbeceb2c87 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:33.020358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-688eb42d-5756-4656-8da7-652a8534236d req-effbe6b7-dbb7-43c2-a635-60cbeceb2c87 service nova] Creating event network-vif-deleted:964b26c8-87b2-4c98-a446-64b394850524 for instance 8ccc877e-8add-4637-87ca-3d598180f495 on hv-cinder-83752 Apr 12 16:22:33.025315 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-688eb42d-5756-4656-8da7-652a8534236d req-effbe6b7-dbb7-43c2-a635-60cbeceb2c87 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029337 Apr 12 16:22:33.025917 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 310/624] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:33.043358 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:33.043933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 8ccc877e-8add-4637-87ca-3d598180f495] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:33.051327 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:33.051777 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:33.052549 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:33.052980 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:33.066847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] HTTP exception thrown: Instance 8ccc877e-8add-4637-87ca-3d598180f495 could not be found. Apr 12 16:22:33.067437 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Returning 404 to user: Instance 8ccc877e-8add-4637-87ca-3d598180f495 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:22:33.068272 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5de319c0-9080-4a1a-be84-10cb5f622ff0 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495" status: 404 len: 111 microversion: 2.1 time: 0.029156 Apr 12 16:22:33.068809 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 315/625] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:33 2022] GET /compute/v2.1/servers/8ccc877e-8add-4637-87ca-3d598180f495 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:22:33.163206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:33.164095 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:33.172221 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:33.172945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:33.173990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:33.174627 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:33.401842 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:33.410794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:33.412272 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:33.413413 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f208f8f4-5309-4b54-9dea-b99e7e8a0f3b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.254641 Apr 12 16:22:33.413981 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 311/626] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:33 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:33.731548 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ac365cd3-c086-4f56-9c00-d159901a3c4c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:33.732183 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ac365cd3-c086-4f56-9c00-d159901a3c4c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:33.740889 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ac365cd3-c086-4f56-9c00-d159901a3c4c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:33.741710 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ac365cd3-c086-4f56-9c00-d159901a3c4c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:33.743014 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ac365cd3-c086-4f56-9c00-d159901a3c4c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:33.743663 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ac365cd3-c086-4f56-9c00-d159901a3c4c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:33.903307 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ac365cd3-c086-4f56-9c00-d159901a3c4c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:33.917242 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ac365cd3-c086-4f56-9c00-d159901a3c4c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.189270 Apr 12 16:22:33.918219 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 316/627] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:33 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:34.433980 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:34.434927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:34.443583 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:34.443933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:34.444717 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:34.445154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:34.588639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:34.598095 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:34.599620 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:34.600795 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ccce2961-f255-4add-84b6-3211a048af26 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.172400 Apr 12 16:22:34.601359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 312/628] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:34 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:34.941045 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b004fcae-c543-44a9-a88e-fd5389c8e967 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:34.942367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b004fcae-c543-44a9-a88e-fd5389c8e967 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:34.949748 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b004fcae-c543-44a9-a88e-fd5389c8e967 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:34.950282 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b004fcae-c543-44a9-a88e-fd5389c8e967 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:34.951053 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b004fcae-c543-44a9-a88e-fd5389c8e967 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:34.951486 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b004fcae-c543-44a9-a88e-fd5389c8e967 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:35.106379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b004fcae-c543-44a9-a88e-fd5389c8e967 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:35.118572 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b004fcae-c543-44a9-a88e-fd5389c8e967 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.183103 Apr 12 16:22:35.119367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 317/629] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:34 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:35.624679 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:35.625240 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:35.632084 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:35.632524 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:35.633314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:35.633738 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:35.776995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:35.786445 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:35.787925 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:35.789118 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0e7c9836-1fd1-4e2e-83b1-37c4994e54ed tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.168408 Apr 12 16:22:35.789675 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 313/630] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:35 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:36.143425 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-581705df-09fc-4854-a191-158024ec7343 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:36.144072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-581705df-09fc-4854-a191-158024ec7343 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:36.151716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-581705df-09fc-4854-a191-158024ec7343 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:36.152174 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-581705df-09fc-4854-a191-158024ec7343 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:36.153069 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-581705df-09fc-4854-a191-158024ec7343 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:36.153540 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-581705df-09fc-4854-a191-158024ec7343 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:36.306206 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-581705df-09fc-4854-a191-158024ec7343 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:36.317336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-581705df-09fc-4854-a191-158024ec7343 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.180814 Apr 12 16:22:36.317885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 318/631] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:36 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:36.807612 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:36.807986 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:36.815467 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:36.816286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:36.817068 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:36.817529 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:36.950350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:36.959387 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:36.960877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:36.962017 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-865c3f15-d1b7-4dbf-88fb-213431df6275 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.158705 Apr 12 16:22:36.962585 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 314/632] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:36 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:37.346906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d9eabaa4-5873-4053-ae9c-f6e9b6640e76 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:37.347517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d9eabaa4-5873-4053-ae9c-f6e9b6640e76 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:37.354363 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9eabaa4-5873-4053-ae9c-f6e9b6640e76 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:37.354812 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9eabaa4-5873-4053-ae9c-f6e9b6640e76 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:37.355573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9eabaa4-5873-4053-ae9c-f6e9b6640e76 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:37.356008 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9eabaa4-5873-4053-ae9c-f6e9b6640e76 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:37.513929 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d9eabaa4-5873-4053-ae9c-f6e9b6640e76 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:37.523871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d9eabaa4-5873-4053-ae9c-f6e9b6640e76 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.182777 Apr 12 16:22:37.524450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 319/633] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:37 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:37.985633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:37.989237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:37.997977 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:37.998867 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:37.999816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:38.000414 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:38.161560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:38.171146 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:38.172727 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:38.173900 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6d5b3aae-6dbb-41c6-a07e-ca66c8d7b07e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.196513 Apr 12 16:22:38.174580 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 315/634] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:37 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:38.546507 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3cbcf269-9e3c-4849-b776-b6b511c88642 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:38.547386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3cbcf269-9e3c-4849-b776-b6b511c88642 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:38.555135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cbcf269-9e3c-4849-b776-b6b511c88642 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:38.555861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cbcf269-9e3c-4849-b776-b6b511c88642 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:38.556832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cbcf269-9e3c-4849-b776-b6b511c88642 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:38.557473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cbcf269-9e3c-4849-b776-b6b511c88642 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:38.716138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3cbcf269-9e3c-4849-b776-b6b511c88642 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:38.724398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3cbcf269-9e3c-4849-b776-b6b511c88642 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.181780 Apr 12 16:22:38.724965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 320/635] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:38 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:39.195669 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:39.196507 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:39.205898 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:39.206414 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:39.207267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:39.207700 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:39.344740 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:39.355939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:39.357452 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:39.358652 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ccb3162f-0a70-4c97-b80a-bdd2c1db8b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.169116 Apr 12 16:22:39.359230 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 316/636] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:39 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:39.741692 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c38d609f-a10a-4795-9aaf-8f6cc6e282f8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:39.743034 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c38d609f-a10a-4795-9aaf-8f6cc6e282f8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:39.749566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c38d609f-a10a-4795-9aaf-8f6cc6e282f8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:39.750448 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c38d609f-a10a-4795-9aaf-8f6cc6e282f8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:39.751506 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c38d609f-a10a-4795-9aaf-8f6cc6e282f8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:39.752306 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c38d609f-a10a-4795-9aaf-8f6cc6e282f8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:39.916824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c38d609f-a10a-4795-9aaf-8f6cc6e282f8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:39.925951 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c38d609f-a10a-4795-9aaf-8f6cc6e282f8 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.188365 Apr 12 16:22:39.926794 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 321/637] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:39 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:40.377780 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:40.378485 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:40.385555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:40.386027 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:40.386822 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:40.387256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:40.530510 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:40.539809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:40.541411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:40.542631 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9c5b4b84-d957-41d9-8a2b-124c7afaaa8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.169058 Apr 12 16:22:40.543302 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 317/638] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:40 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:40.944727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-02e845e4-9111-45f6-bca7-f2bc87236d7e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:40.946078 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-02e845e4-9111-45f6-bca7-f2bc87236d7e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:40.952541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-02e845e4-9111-45f6-bca7-f2bc87236d7e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:40.953108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-02e845e4-9111-45f6-bca7-f2bc87236d7e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:40.954004 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-02e845e4-9111-45f6-bca7-f2bc87236d7e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:40.954530 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-02e845e4-9111-45f6-bca7-f2bc87236d7e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:41.106402 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-02e845e4-9111-45f6-bca7-f2bc87236d7e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:41.114855 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-02e845e4-9111-45f6-bca7-f2bc87236d7e tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.174470 Apr 12 16:22:41.115425 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 322/639] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:40 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:41.562957 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:41.563689 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:41.571244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:41.571687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:41.572473 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:41.572910 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:41.721043 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:41.731898 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:41.733606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:41.734863 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-24367e26-a68b-4757-820e-c7333c99f484 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.175869 Apr 12 16:22:41.735436 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 318/640] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:41 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:42.134884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a54addff-e48c-467b-98bd-bb6cfd23337b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:42.135632 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a54addff-e48c-467b-98bd-bb6cfd23337b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:42.141965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a54addff-e48c-467b-98bd-bb6cfd23337b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:42.142525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a54addff-e48c-467b-98bd-bb6cfd23337b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:42.143483 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a54addff-e48c-467b-98bd-bb6cfd23337b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:42.144054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a54addff-e48c-467b-98bd-bb6cfd23337b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:42.301240 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a54addff-e48c-467b-98bd-bb6cfd23337b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:42.310166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a54addff-e48c-467b-98bd-bb6cfd23337b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.179150 Apr 12 16:22:42.310761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 323/641] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:42 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:42.753107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:42.753823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:42.760939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:42.761396 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:42.762335 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:42.762847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:42.905533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:42.917633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:42.919176 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:42.920367 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c4a32f9c-0ddc-4f74-b952-3760aa6d0a80 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.171386 Apr 12 16:22:42.920988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 319/642] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:42 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:43.330376 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5dd3669a-b230-4944-911a-8d0238dc2f0d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:43.331145 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5dd3669a-b230-4944-911a-8d0238dc2f0d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:43.338087 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5dd3669a-b230-4944-911a-8d0238dc2f0d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:43.338832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5dd3669a-b230-4944-911a-8d0238dc2f0d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:43.339614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5dd3669a-b230-4944-911a-8d0238dc2f0d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:43.340050 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5dd3669a-b230-4944-911a-8d0238dc2f0d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:43.498323 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5dd3669a-b230-4944-911a-8d0238dc2f0d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:43.507198 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5dd3669a-b230-4944-911a-8d0238dc2f0d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.183071 Apr 12 16:22:43.507911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 324/643] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:43 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:43.940367 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:43.941044 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:43.948712 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:43.949298 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:43.950383 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:43.951828 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:44.093946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:44.102326 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:44.103834 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:44.104973 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c1c0f94b-e662-4f16-8490-b59b95f76cbb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.168711 Apr 12 16:22:44.105533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 320/644] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:43 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:44.527229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0dd5d892-028c-4737-932d-38216fca4746 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:44.527887 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0dd5d892-028c-4737-932d-38216fca4746 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:44.535503 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0dd5d892-028c-4737-932d-38216fca4746 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:44.535951 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0dd5d892-028c-4737-932d-38216fca4746 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:44.536720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0dd5d892-028c-4737-932d-38216fca4746 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:44.537149 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0dd5d892-028c-4737-932d-38216fca4746 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:44.685687 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0dd5d892-028c-4737-932d-38216fca4746 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:44.697580 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0dd5d892-028c-4737-932d-38216fca4746 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.176040 Apr 12 16:22:44.698090 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 325/645] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:44 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:45.134731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:45.135451 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:45.143434 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:45.144061 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:45.144824 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:45.145239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:45.223887 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1047457313", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "networks": [{"uuid": "453187e0-f48e-47e4-b989-372e2d63b9b3"}]}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:45.275689 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:45.283203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] validate_networks() for [('453187e0-f48e-47e4-b989-372e2d63b9b3', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:22:45.284504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:45.285983 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:45.287158 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-75af1489-442c-4f2e-9119-1e1696b4b431 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.168459 Apr 12 16:22:45.287713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 321/646] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:45 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:45.638849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:22:45.639357 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:22:45.639762 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:22:45.640143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:22:45.640599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:22:45.650763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:45.651147 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:45.651957 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:45.652481 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:45.670583 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Getting quotas for project 3cca5abe3a804deeb910d0d5920c6b6e. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:22:45.675106 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Getting quotas for user c63ecebba0d84bd7a2dc6e1f8b152001 and project 3cca5abe3a804deeb910d0d5920c6b6e. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:22:45.691459 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:22:45.693917 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:22:45.721370 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a891f4ad-cc98-4141-bf0d-04022cd41b93 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:45.722176 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a891f4ad-cc98-4141-bf0d-04022cd41b93 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:45.729480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a891f4ad-cc98-4141-bf0d-04022cd41b93 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:45.729994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a891f4ad-cc98-4141-bf0d-04022cd41b93 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:45.730856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a891f4ad-cc98-4141-bf0d-04022cd41b93 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:45.731366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a891f4ad-cc98-4141-bf0d-04022cd41b93 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:45.742707 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-edb3c03b-ad6c-4da7-b972-61fcf98340aa tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523160 Apr 12 16:22:45.743447 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 326/647] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:22:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 12 16:22:45.753674 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ea12ab4f-e3ba-4088-970c-dc55be2a3b88 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:45.754418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ea12ab4f-e3ba-4088-970c-dc55be2a3b88 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:45.835344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ea12ab4f-e3ba-4088-970c-dc55be2a3b88 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:45.842711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ea12ab4f-e3ba-4088-970c-dc55be2a3b88 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1219 microversion: 2.1 time: 0.093160 Apr 12 16:22:45.843536 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 327/648] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:45 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:45.932616 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a891f4ad-cc98-4141-bf0d-04022cd41b93 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:45.941290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a891f4ad-cc98-4141-bf0d-04022cd41b93 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.224285 Apr 12 16:22:45.942018 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 322/649] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:45 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:46.306281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:46.306892 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:46.314135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:46.314803 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:46.315679 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:46.317589 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:46.452890 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:46.463216 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:46.464696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:46.465862 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-03f6bed0-b0e5-4443-bc5c-332addbf43ee tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.163642 Apr 12 16:22:46.466659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 328/650] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:46 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:46.860467 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-19b3a8e4-c49f-4b3d-a810-ce40cabb5026 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:46.861112 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-19b3a8e4-c49f-4b3d-a810-ce40cabb5026 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:46.867932 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-19b3a8e4-c49f-4b3d-a810-ce40cabb5026 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:46.868378 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-19b3a8e4-c49f-4b3d-a810-ce40cabb5026 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:46.869140 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-19b3a8e4-c49f-4b3d-a810-ce40cabb5026 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:46.869570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-19b3a8e4-c49f-4b3d-a810-ce40cabb5026 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:46.934623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-19b3a8e4-c49f-4b3d-a810-ce40cabb5026 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:46.943550 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-19b3a8e4-c49f-4b3d-a810-ce40cabb5026 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.086981 Apr 12 16:22:46.944138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 323/651] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:46 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:46.959416 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ddffe4ec-189d-4de3-bf9f-a62f28765680 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:46.960064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ddffe4ec-189d-4de3-bf9f-a62f28765680 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:46.966471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ddffe4ec-189d-4de3-bf9f-a62f28765680 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:46.966919 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ddffe4ec-189d-4de3-bf9f-a62f28765680 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:46.967719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ddffe4ec-189d-4de3-bf9f-a62f28765680 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:46.968147 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ddffe4ec-189d-4de3-bf9f-a62f28765680 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:47.125978 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ddffe4ec-189d-4de3-bf9f-a62f28765680 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:47.135441 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ddffe4ec-189d-4de3-bf9f-a62f28765680 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.180204 Apr 12 16:22:47.136010 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 329/652] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:46 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:47.488072 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:47.488735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:47.496636 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:47.497171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:47.498021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:47.498518 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:47.655333 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:47.664537 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:47.667458 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:47.668663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b3907685-0493-4ec4-9373-7752b20c6c67 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.186833 Apr 12 16:22:47.669265 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 324/653] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:47 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:47.960579 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e6be32f1-004f-435f-adf9-a1ba3c493a82 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:47.961211 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e6be32f1-004f-435f-adf9-a1ba3c493a82 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:47.968325 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e6be32f1-004f-435f-adf9-a1ba3c493a82 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:47.968783 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e6be32f1-004f-435f-adf9-a1ba3c493a82 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:47.969555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e6be32f1-004f-435f-adf9-a1ba3c493a82 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:47.969987 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e6be32f1-004f-435f-adf9-a1ba3c493a82 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:48.037186 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e6be32f1-004f-435f-adf9-a1ba3c493a82 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:48.045215 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e6be32f1-004f-435f-adf9-a1ba3c493a82 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.088497 Apr 12 16:22:48.045806 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 330/654] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:47 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:48.153567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8c8ed7a0-a5f9-4d63-b400-706990d378db tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:48.154385 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8c8ed7a0-a5f9-4d63-b400-706990d378db tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:48.161616 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c8ed7a0-a5f9-4d63-b400-706990d378db tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:48.162080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c8ed7a0-a5f9-4d63-b400-706990d378db tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:48.162954 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c8ed7a0-a5f9-4d63-b400-706990d378db tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:48.163416 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c8ed7a0-a5f9-4d63-b400-706990d378db tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:48.314240 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8c8ed7a0-a5f9-4d63-b400-706990d378db tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:48.324842 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8c8ed7a0-a5f9-4d63-b400-706990d378db tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.175190 Apr 12 16:22:48.325418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 325/655] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:48 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:48.687912 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:48.688655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:48.695408 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:48.695963 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:48.696755 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:48.697201 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:48.834843 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:48.843871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:48.845437 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:48.846967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8ed25fa7-db60-4cc1-998c-587354e73f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.163029 Apr 12 16:22:48.847551 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 331/656] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:48 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:49.063102 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-956b8621-0d14-47b9-9913-f873b2a2121e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:49.063757 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-956b8621-0d14-47b9-9913-f873b2a2121e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:49.071160 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-956b8621-0d14-47b9-9913-f873b2a2121e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:49.071621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-956b8621-0d14-47b9-9913-f873b2a2121e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:49.072579 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-956b8621-0d14-47b9-9913-f873b2a2121e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:49.073081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-956b8621-0d14-47b9-9913-f873b2a2121e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:49.142124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-956b8621-0d14-47b9-9913-f873b2a2121e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:49.151131 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-956b8621-0d14-47b9-9913-f873b2a2121e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.092100 Apr 12 16:22:49.151946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 326/657] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:49 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:49.348645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d39c9978-6ee4-4b69-9b14-a6704941c359 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:49.349235 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d39c9978-6ee4-4b69-9b14-a6704941c359 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:49.355856 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d39c9978-6ee4-4b69-9b14-a6704941c359 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:49.356303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d39c9978-6ee4-4b69-9b14-a6704941c359 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:49.357081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d39c9978-6ee4-4b69-9b14-a6704941c359 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:49.357504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d39c9978-6ee4-4b69-9b14-a6704941c359 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:49.530886 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d39c9978-6ee4-4b69-9b14-a6704941c359 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:49.540102 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d39c9978-6ee4-4b69-9b14-a6704941c359 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.196156 Apr 12 16:22:49.540899 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 332/658] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:49 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:49.865389 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:49.865999 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:49.872832 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:49.873289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:49.874076 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:49.874526 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:50.020682 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:50.029505 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:50.031026 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:50.032157 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-44985e10-c674-44b0-9043-c71abfc06ee9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.170841 Apr 12 16:22:50.032929 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 327/659] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:49 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:50.168713 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ea6caca4-5823-4c7d-bb56-ae5a52aa6dfc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:50.169466 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ea6caca4-5823-4c7d-bb56-ae5a52aa6dfc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:50.177189 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ea6caca4-5823-4c7d-bb56-ae5a52aa6dfc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:50.178137 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ea6caca4-5823-4c7d-bb56-ae5a52aa6dfc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:50.178930 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ea6caca4-5823-4c7d-bb56-ae5a52aa6dfc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:50.179379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ea6caca4-5823-4c7d-bb56-ae5a52aa6dfc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:50.250204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ea6caca4-5823-4c7d-bb56-ae5a52aa6dfc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:50.258642 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ea6caca4-5823-4c7d-bb56-ae5a52aa6dfc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.093782 Apr 12 16:22:50.259233 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 333/660] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:50 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:50.558433 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b153e128-8f30-4f19-8fed-13b8fec24051 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:50.559033 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b153e128-8f30-4f19-8fed-13b8fec24051 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:50.565617 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b153e128-8f30-4f19-8fed-13b8fec24051 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:50.566071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b153e128-8f30-4f19-8fed-13b8fec24051 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:50.566861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b153e128-8f30-4f19-8fed-13b8fec24051 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:50.567293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b153e128-8f30-4f19-8fed-13b8fec24051 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:50.718706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b153e128-8f30-4f19-8fed-13b8fec24051 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:50.728272 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b153e128-8f30-4f19-8fed-13b8fec24051 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.173830 Apr 12 16:22:50.728986 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 328/661] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:50 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:51.050894 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:51.051525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:51.058135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:51.058595 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:51.059373 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:51.059815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:51.199459 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:51.209924 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:51.211424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:51.212614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-fdbf4033-4157-42f0-82db-064980c76f20 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.165980 Apr 12 16:22:51.213188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 334/662] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:51 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:51.276302 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-47c9e7ed-5002-41b4-9d41-cc769f5b9c71 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:51.276889 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-47c9e7ed-5002-41b4-9d41-cc769f5b9c71 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:51.283620 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47c9e7ed-5002-41b4-9d41-cc769f5b9c71 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:51.284067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47c9e7ed-5002-41b4-9d41-cc769f5b9c71 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:51.284830 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47c9e7ed-5002-41b4-9d41-cc769f5b9c71 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:51.285256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47c9e7ed-5002-41b4-9d41-cc769f5b9c71 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:51.350840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-47c9e7ed-5002-41b4-9d41-cc769f5b9c71 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:51.358394 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-47c9e7ed-5002-41b4-9d41-cc769f5b9c71 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.085999 Apr 12 16:22:51.358960 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 329/663] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:51 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:51.749936 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-457a0280-e948-4d1f-8112-f894cd9de4cb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:51.750736 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-457a0280-e948-4d1f-8112-f894cd9de4cb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:51.760233 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-457a0280-e948-4d1f-8112-f894cd9de4cb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:51.760915 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-457a0280-e948-4d1f-8112-f894cd9de4cb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:51.762113 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-457a0280-e948-4d1f-8112-f894cd9de4cb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:51.762772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-457a0280-e948-4d1f-8112-f894cd9de4cb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:51.913867 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-457a0280-e948-4d1f-8112-f894cd9de4cb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:51.922447 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-457a0280-e948-4d1f-8112-f894cd9de4cb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.179555 Apr 12 16:22:51.922992 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 335/664] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:51 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:22:52.232759 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:52.233368 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:52.239864 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:52.240309 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:52.241071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:52.241500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:52.377193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9fd83950-ed51-4937-a319-9008fdb90228 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:52.378459 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9fd83950-ed51-4937-a319-9008fdb90228 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:52.385683 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fd83950-ed51-4937-a319-9008fdb90228 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:52.386080 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fd83950-ed51-4937-a319-9008fdb90228 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:52.386899 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fd83950-ed51-4937-a319-9008fdb90228 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:52.387348 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fd83950-ed51-4937-a319-9008fdb90228 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:52.393348 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:52.402843 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:52.404428 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:52.405859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d81e8b45-5dd0-40c7-9155-e5aefd213b10 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.177024 Apr 12 16:22:52.406752 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 330/665] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:52 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:52.455206 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9fd83950-ed51-4937-a319-9008fdb90228 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:52.463633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9fd83950-ed51-4937-a319-9008fdb90228 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.091330 Apr 12 16:22:52.464216 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 336/666] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:52 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:52.940233 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-dad41ab0-e9ab-42e7-8440-8b9bc2a1a473 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:52.940843 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-dad41ab0-e9ab-42e7-8440-8b9bc2a1a473 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:52.947230 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dad41ab0-e9ab-42e7-8440-8b9bc2a1a473 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:52.947673 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dad41ab0-e9ab-42e7-8440-8b9bc2a1a473 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:52.948447 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dad41ab0-e9ab-42e7-8440-8b9bc2a1a473 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:52.948874 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dad41ab0-e9ab-42e7-8440-8b9bc2a1a473 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:53.099818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dad41ab0-e9ab-42e7-8440-8b9bc2a1a473 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:53.108023 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-dad41ab0-e9ab-42e7-8440-8b9bc2a1a473 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.172171 Apr 12 16:22:53.108594 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 331/667] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:52 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:53.425152 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:53.425790 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:53.432454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:53.432907 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:53.433649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:53.434106 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:53.481002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7be262ed-a19e-4575-8dd9-0e473ca33927 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:53.481622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7be262ed-a19e-4575-8dd9-0e473ca33927 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:53.488426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7be262ed-a19e-4575-8dd9-0e473ca33927 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:53.489022 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7be262ed-a19e-4575-8dd9-0e473ca33927 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:53.489819 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7be262ed-a19e-4575-8dd9-0e473ca33927 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:53.490405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7be262ed-a19e-4575-8dd9-0e473ca33927 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:53.556809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-7be262ed-a19e-4575-8dd9-0e473ca33927 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:53.564290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7be262ed-a19e-4575-8dd9-0e473ca33927 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.087101 Apr 12 16:22:53.564880 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 332/668] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:53 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:53.597643 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:53.606746 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:53.608313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:53.609496 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ac2adf51-1d96-4ca9-87d0-3d8159517d8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.188582 Apr 12 16:22:53.610076 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 337/669] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:53 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:54.126892 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6766de2f-9183-4391-b95f-2dff72474bbb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:54.127534 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6766de2f-9183-4391-b95f-2dff72474bbb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:54.134650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6766de2f-9183-4391-b95f-2dff72474bbb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:54.135104 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6766de2f-9183-4391-b95f-2dff72474bbb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:54.135894 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6766de2f-9183-4391-b95f-2dff72474bbb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:54.136334 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6766de2f-9183-4391-b95f-2dff72474bbb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:54.300474 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6766de2f-9183-4391-b95f-2dff72474bbb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:54.308769 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6766de2f-9183-4391-b95f-2dff72474bbb tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.185787 Apr 12 16:22:54.309364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 333/670] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:54 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:54.585030 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-67555df8-7fdd-439c-a62a-b61498b06cca tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:54.585711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-67555df8-7fdd-439c-a62a-b61498b06cca tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:54.595156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-67555df8-7fdd-439c-a62a-b61498b06cca tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:54.596279 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-67555df8-7fdd-439c-a62a-b61498b06cca tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:54.597187 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-67555df8-7fdd-439c-a62a-b61498b06cca tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:54.597629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-67555df8-7fdd-439c-a62a-b61498b06cca tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:54.628121 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:54.628695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:54.636893 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:54.637343 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:54.638137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:54.638584 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:54.659472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-67555df8-7fdd-439c-a62a-b61498b06cca tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:54.667144 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-67555df8-7fdd-439c-a62a-b61498b06cca tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.087244 Apr 12 16:22:54.667632 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 338/671] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:54 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:54.781902 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:54.790534 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:54.792015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:54.793169 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1bc998a1-029b-45a4-8c3d-7e8411eff8b4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.169311 Apr 12 16:22:54.793720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 334/672] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:54 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:55.330823 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-84050961-a979-434c-8f86-4b41fb18c990 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:55.331815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-84050961-a979-434c-8f86-4b41fb18c990 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:55.342079 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-84050961-a979-434c-8f86-4b41fb18c990 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:55.342823 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-84050961-a979-434c-8f86-4b41fb18c990 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:55.344091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-84050961-a979-434c-8f86-4b41fb18c990 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:55.344804 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-84050961-a979-434c-8f86-4b41fb18c990 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:55.496071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-84050961-a979-434c-8f86-4b41fb18c990 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:55.505703 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-84050961-a979-434c-8f86-4b41fb18c990 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.181801 Apr 12 16:22:55.506480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 339/673] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:55 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:55.687429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2245d38e-3c5c-4fce-b988-02d64efd19fc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:55.688211 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2245d38e-3c5c-4fce-b988-02d64efd19fc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:55.697008 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2245d38e-3c5c-4fce-b988-02d64efd19fc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:55.697691 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2245d38e-3c5c-4fce-b988-02d64efd19fc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:55.698892 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2245d38e-3c5c-4fce-b988-02d64efd19fc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:55.699555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2245d38e-3c5c-4fce-b988-02d64efd19fc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:55.764976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2245d38e-3c5c-4fce-b988-02d64efd19fc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:55.772657 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2245d38e-3c5c-4fce-b988-02d64efd19fc tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1223 microversion: 2.1 time: 0.090937 Apr 12 16:22:55.773227 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 335/674] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:55 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:55.811645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:55.812177 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:55.819154 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:55.819598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:55.820424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:55.820896 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:55.971334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:55.979876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:55.981394 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:55.982591 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3d0e1578-081b-4ce6-a92c-d56bab7f2958 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.174936 Apr 12 16:22:55.983157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 340/675] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:55 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:22:56.523093 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-78dfa937-296d-4ce1-b094-a26d9f7f55d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:56.523696 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-78dfa937-296d-4ce1-b094-a26d9f7f55d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:56.530071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-78dfa937-296d-4ce1-b094-a26d9f7f55d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:56.530546 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-78dfa937-296d-4ce1-b094-a26d9f7f55d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:56.531305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-78dfa937-296d-4ce1-b094-a26d9f7f55d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:56.531733 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-78dfa937-296d-4ce1-b094-a26d9f7f55d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:56.676614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-78dfa937-296d-4ce1-b094-a26d9f7f55d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:56.689339 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-78dfa937-296d-4ce1-b094-a26d9f7f55d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1755 microversion: 2.1 time: 0.169841 Apr 12 16:22:56.690376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 336/676] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:56 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:56.797826 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5abf60b6-78b4-42f4-a386-035ddb7aeb28 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:56.798887 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5abf60b6-78b4-42f4-a386-035ddb7aeb28 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:56.808786 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5abf60b6-78b4-42f4-a386-035ddb7aeb28 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:56.809553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5abf60b6-78b4-42f4-a386-035ddb7aeb28 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:56.810855 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5abf60b6-78b4-42f4-a386-035ddb7aeb28 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:56.811583 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5abf60b6-78b4-42f4-a386-035ddb7aeb28 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:56.875351 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5abf60b6-78b4-42f4-a386-035ddb7aeb28 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:56.883955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5abf60b6-78b4-42f4-a386-035ddb7aeb28 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1215 microversion: 2.1 time: 0.092510 Apr 12 16:22:56.884535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 341/677] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:56 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:57.001158 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:57.001917 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:57.011248 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:57.011731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:57.012537 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:57.012976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:57.156397 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:57.165694 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:57.167410 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:57.168865 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-87cd7106-361d-4dff-a82f-509c632e07e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.171861 Apr 12 16:22:57.169512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 337/678] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:56 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:57.707127 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-97ab89c8-6ca0-4526-a6f4-642d62a7c808 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:57.707861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-97ab89c8-6ca0-4526-a6f4-642d62a7c808 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:57.714174 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-97ab89c8-6ca0-4526-a6f4-642d62a7c808 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:57.714621 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-97ab89c8-6ca0-4526-a6f4-642d62a7c808 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:57.715378 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-97ab89c8-6ca0-4526-a6f4-642d62a7c808 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:57.715805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-97ab89c8-6ca0-4526-a6f4-642d62a7c808 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:57.885211 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-97ab89c8-6ca0-4526-a6f4-642d62a7c808 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:57.894262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-97ab89c8-6ca0-4526-a6f4-642d62a7c808 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1758 microversion: 2.1 time: 0.191469 Apr 12 16:22:57.894809 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 342/679] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:57 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:57.900623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-05f6a872-6012-4324-bafe-58213af9e66f tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:57.901331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-05f6a872-6012-4324-bafe-58213af9e66f tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:57.907646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05f6a872-6012-4324-bafe-58213af9e66f tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:57.908274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05f6a872-6012-4324-bafe-58213af9e66f tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:57.909076 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05f6a872-6012-4324-bafe-58213af9e66f tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:57.909512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05f6a872-6012-4324-bafe-58213af9e66f tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:57.973350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-05f6a872-6012-4324-bafe-58213af9e66f tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:57.980904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-05f6a872-6012-4324-bafe-58213af9e66f tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1271 microversion: 2.1 time: 0.084060 Apr 12 16:22:57.981605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 338/680] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:57 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:58.200067 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:58.201065 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:58.211353 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:58.212041 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:58.213308 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:58.213988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:58.376049 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:58.385764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:58.387442 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:58.388616 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7dabc9ab-d759-4fab-b4c7-3bf402511747 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.194484 Apr 12 16:22:58.389189 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 343/681] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:58 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:22:58.997933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d42f426d-d27a-47d1-8740-fd036297f858 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:58.998586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d42f426d-d27a-47d1-8740-fd036297f858 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:59.005415 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d42f426d-d27a-47d1-8740-fd036297f858 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:59.005892 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d42f426d-d27a-47d1-8740-fd036297f858 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:59.006700 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d42f426d-d27a-47d1-8740-fd036297f858 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:59.007133 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d42f426d-d27a-47d1-8740-fd036297f858 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:59.082649 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d42f426d-d27a-47d1-8740-fd036297f858 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:59.090021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d42f426d-d27a-47d1-8740-fd036297f858 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1277 microversion: 2.1 time: 0.095997 Apr 12 16:22:59.090873 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 339/682] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:22:58 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:59.412885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:59.413475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:22:59.420261 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:59.420686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:59.421454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:22:59.421854 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:22:59.620047 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:59.629901 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:59.631493 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:22:59.632729 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-51fba3c7-0884-42ed-b7d7-f2b5c5a9685e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.223812 Apr 12 16:22:59.633352 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 344/683] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:22:59 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:00.108250 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d5896a81-f297-4645-91de-30c5cd56526d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:00.108831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d5896a81-f297-4645-91de-30c5cd56526d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:00.115362 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d5896a81-f297-4645-91de-30c5cd56526d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:00.115809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d5896a81-f297-4645-91de-30c5cd56526d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:00.116581 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d5896a81-f297-4645-91de-30c5cd56526d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:00.117003 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d5896a81-f297-4645-91de-30c5cd56526d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:00.202617 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-00ee8823-b853-4e56-8798-3152d8cc4219 req-b7341e9f-2e88-4425-b887-b91e1e65f7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e1eb9a-45b4-4544-9f82-0af5e1705f6d", "tag": "3f75fe13-2bb9-45aa-b722-a916232b255c"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:00.214362 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-00ee8823-b853-4e56-8798-3152d8cc4219 req-b7341e9f-2e88-4425-b887-b91e1e65f7ed service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:00.214926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-00ee8823-b853-4e56-8798-3152d8cc4219 req-b7341e9f-2e88-4425-b887-b91e1e65f7ed service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:00.226668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-00ee8823-b853-4e56-8798-3152d8cc4219 req-b7341e9f-2e88-4425-b887-b91e1e65f7ed service nova] Creating event network-changed:3f75fe13-2bb9-45aa-b722-a916232b255c for instance 66e1eb9a-45b4-4544-9f82-0af5e1705f6d on hv-cinder-83752 Apr 12 16:23:00.237100 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-00ee8823-b853-4e56-8798-3152d8cc4219 req-b7341e9f-2e88-4425-b887-b91e1e65f7ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038405 Apr 12 16:23:00.238008 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 345/684] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:00.324778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d5896a81-f297-4645-91de-30c5cd56526d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:00.334710 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d5896a81-f297-4645-91de-30c5cd56526d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1319 microversion: 2.1 time: 0.230455 Apr 12 16:23:00.335520 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 340/685] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:00 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:00.652545 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:00.653361 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:00.660107 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:00.660537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:00.661339 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:00.661773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:00.805685 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:00.818810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:00.820993 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:00.823081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3b49cdc1-5470-40b8-ae6f-107d9fdcca81 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.174915 Apr 12 16:23:00.823744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 346/686] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:00 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:01.356288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9d530d70-2848-4f67-bc72-7321cad7757e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:01.357252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9d530d70-2848-4f67-bc72-7321cad7757e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:01.367935 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d530d70-2848-4f67-bc72-7321cad7757e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:01.368663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d530d70-2848-4f67-bc72-7321cad7757e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:01.369916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d530d70-2848-4f67-bc72-7321cad7757e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:01.370671 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d530d70-2848-4f67-bc72-7321cad7757e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:01.513630 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9d530d70-2848-4f67-bc72-7321cad7757e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:01.522032 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9d530d70-2848-4f67-bc72-7321cad7757e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1319 microversion: 2.1 time: 0.172197 Apr 12 16:23:01.522638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 341/687] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:01 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:01.843211 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:01.843783 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:01.850677 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:01.851122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:01.851881 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:01.852313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:02.002559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:02.011176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:02.012662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:02.013818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cf48c7a0-a8b0-466e-a19a-d73780419559 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.174565 Apr 12 16:23:02.014413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 347/688] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:01 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:02.541724 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c5c4fdf3-992a-4b0b-a132-72a002641365 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:02.542524 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c5c4fdf3-992a-4b0b-a132-72a002641365 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:02.551293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c5c4fdf3-992a-4b0b-a132-72a002641365 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:02.551743 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c5c4fdf3-992a-4b0b-a132-72a002641365 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:02.552509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c5c4fdf3-992a-4b0b-a132-72a002641365 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:02.552943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c5c4fdf3-992a-4b0b-a132-72a002641365 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:02.696778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c5c4fdf3-992a-4b0b-a132-72a002641365 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:02.710491 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c5c4fdf3-992a-4b0b-a132-72a002641365 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1319 microversion: 2.1 time: 0.174500 Apr 12 16:23:02.711433 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 342/689] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:02 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:03.032588 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:03.034222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:03.040902 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:03.041416 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:03.042218 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:03.042654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:03.196308 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:03.205558 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:03.207098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:03.208268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d8528cc4-0613-4bf7-b880-cfd9a81f6b93 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.179738 Apr 12 16:23:03.208804 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 348/690] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:03 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:03.736818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2ff250c1-612c-4190-81a6-9890de5b2776 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:03.737633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2ff250c1-612c-4190-81a6-9890de5b2776 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:03.744841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2ff250c1-612c-4190-81a6-9890de5b2776 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:03.745292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2ff250c1-612c-4190-81a6-9890de5b2776 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:03.746154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2ff250c1-612c-4190-81a6-9890de5b2776 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:03.746582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2ff250c1-612c-4190-81a6-9890de5b2776 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:03.875072 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2ff250c1-612c-4190-81a6-9890de5b2776 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:03.883202 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2ff250c1-612c-4190-81a6-9890de5b2776 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1319 microversion: 2.1 time: 0.153426 Apr 12 16:23:03.883774 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 343/691] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:03 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:04.227083 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:04.227686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:04.234435 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:04.234876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:04.235651 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:04.236246 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:04.368044 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:04.377084 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:04.378902 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:04.380164 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-22e4a827-41c0-47f8-bdfc-70b9d801ceda tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.156966 Apr 12 16:23:04.380719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 349/692] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:04 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:04.908262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a1508dd4-69be-4a2f-a3b8-f93832fc26f9 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:04.908875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a1508dd4-69be-4a2f-a3b8-f93832fc26f9 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:04.915946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a1508dd4-69be-4a2f-a3b8-f93832fc26f9 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:04.916404 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a1508dd4-69be-4a2f-a3b8-f93832fc26f9 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:04.917221 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a1508dd4-69be-4a2f-a3b8-f93832fc26f9 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:04.917657 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a1508dd4-69be-4a2f-a3b8-f93832fc26f9 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:05.074356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a1508dd4-69be-4a2f-a3b8-f93832fc26f9 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:05.082203 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a1508dd4-69be-4a2f-a3b8-f93832fc26f9 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1319 microversion: 2.1 time: 0.180808 Apr 12 16:23:05.082796 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 344/693] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:04 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:05.402413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:05.403478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:05.414243 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:05.415005 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:05.416409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:05.417140 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:05.557103 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:05.566007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:05.567518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:05.568678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dc93085e-410e-46ec-ad45-4604f0eed966 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.172873 Apr 12 16:23:05.569279 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 350/694] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:05 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:06.104011 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-23ce0535-5000-4b76-955e-8f508204d418 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:06.105002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-23ce0535-5000-4b76-955e-8f508204d418 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:06.114209 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-23ce0535-5000-4b76-955e-8f508204d418 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:06.114642 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-23ce0535-5000-4b76-955e-8f508204d418 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:06.115453 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-23ce0535-5000-4b76-955e-8f508204d418 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:06.115897 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-23ce0535-5000-4b76-955e-8f508204d418 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:06.247499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-23ce0535-5000-4b76-955e-8f508204d418 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:06.255194 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-23ce0535-5000-4b76-955e-8f508204d418 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1319 microversion: 2.1 time: 0.157946 Apr 12 16:23:06.255776 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 345/695] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:06 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:06.591104 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:06.592096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:06.600331 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:06.600784 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:06.601556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:06.601994 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:06.735991 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:06.745157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:06.746698 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:06.747854 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b0db1c4d-da8e-44e0-a88b-ebba80cc2ed5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.163473 Apr 12 16:23:06.748426 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 351/696] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:06 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:06.803836 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-6ab715ae-23bf-44f9-8bde-d1690a973415 req-bcd3755a-761d-4f56-8fbc-cb833fc95d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e1eb9a-45b4-4544-9f82-0af5e1705f6d", "name": "network-vif-plugged", "status": "completed", "tag": "3f75fe13-2bb9-45aa-b722-a916232b255c"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:06.812943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-6ab715ae-23bf-44f9-8bde-d1690a973415 req-bcd3755a-761d-4f56-8fbc-cb833fc95d76 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:06.813391 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-6ab715ae-23bf-44f9-8bde-d1690a973415 req-bcd3755a-761d-4f56-8fbc-cb833fc95d76 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:06.824868 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-6ab715ae-23bf-44f9-8bde-d1690a973415 req-bcd3755a-761d-4f56-8fbc-cb833fc95d76 service nova] Creating event network-vif-plugged:3f75fe13-2bb9-45aa-b722-a916232b255c for instance 66e1eb9a-45b4-4544-9f82-0af5e1705f6d on hv-cinder-83752 Apr 12 16:23:06.830703 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-6ab715ae-23bf-44f9-8bde-d1690a973415 req-bcd3755a-761d-4f56-8fbc-cb833fc95d76 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030506 Apr 12 16:23:06.831271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 346/697] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:07.272728 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3d249073-7709-4484-80c8-07357c3fc67c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:07.273336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3d249073-7709-4484-80c8-07357c3fc67c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:07.280373 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d249073-7709-4484-80c8-07357c3fc67c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:07.280846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d249073-7709-4484-80c8-07357c3fc67c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:07.281704 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d249073-7709-4484-80c8-07357c3fc67c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:07.282245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3d249073-7709-4484-80c8-07357c3fc67c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:07.420310 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3d249073-7709-4484-80c8-07357c3fc67c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:07.428117 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3d249073-7709-4484-80c8-07357c3fc67c tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1319 microversion: 2.1 time: 0.159286 Apr 12 16:23:07.428710 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 352/698] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:07 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:07.770513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:07.771142 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:07.777809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:07.778301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:07.779081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:07.779512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:07.916441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:07.925632 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:07.927147 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:07.928285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9b1d1501-f6c6-4e0e-a8b4-49d2cd5de3c5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.163731 Apr 12 16:23:07.928848 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 347/699] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:07 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:08.449579 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ba46cb1a-8917-4181-afae-49ea7a710fdb tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:08.450718 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ba46cb1a-8917-4181-afae-49ea7a710fdb tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:08.459291 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ba46cb1a-8917-4181-afae-49ea7a710fdb tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:08.459742 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ba46cb1a-8917-4181-afae-49ea7a710fdb tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:08.460495 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ba46cb1a-8917-4181-afae-49ea7a710fdb tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:08.460945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ba46cb1a-8917-4181-afae-49ea7a710fdb tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:08.602418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ba46cb1a-8917-4181-afae-49ea7a710fdb tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:08.613553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ba46cb1a-8917-4181-afae-49ea7a710fdb tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1319 microversion: 2.1 time: 0.170635 Apr 12 16:23:08.614166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 353/700] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:08 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:08.948820 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:08.949429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:08.958589 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:08.959081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:08.959903 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:08.960336 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:09.115460 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:09.125083 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:09.126702 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:09.128121 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-65d3b939-491d-4d25-bb88-d51d0323d7c9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.183894 Apr 12 16:23:09.128668 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 348/701] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:08 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:09.632817 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-29d29d1e-9917-4818-bf8c-d7a941ff9a4e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:09.632817 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-29d29d1e-9917-4818-bf8c-d7a941ff9a4e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:09.641110 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29d29d1e-9917-4818-bf8c-d7a941ff9a4e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:09.641559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29d29d1e-9917-4818-bf8c-d7a941ff9a4e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:09.642588 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29d29d1e-9917-4818-bf8c-d7a941ff9a4e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:09.643115 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29d29d1e-9917-4818-bf8c-d7a941ff9a4e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:09.791972 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-29d29d1e-9917-4818-bf8c-d7a941ff9a4e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:09.801872 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-29d29d1e-9917-4818-bf8c-d7a941ff9a4e tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1506 microversion: 2.1 time: 0.173854 Apr 12 16:23:09.802455 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 354/702] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:09 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:09.818855 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bf79409b-2851-4158-a3eb-d313966d8233 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3369e213-e5be-4365-9340-ff4c08398e3e", "device": "/dev/sdb"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:09.819969 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bf79409b-2851-4158-a3eb-d313966d8233 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:09.826637 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bf79409b-2851-4158-a3eb-d313966d8233 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:09.827077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bf79409b-2851-4158-a3eb-d313966d8233 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:09.827840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bf79409b-2851-4158-a3eb-d313966d8233 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:09.828239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bf79409b-2851-4158-a3eb-d313966d8233 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:10.151297 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:10.151908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:10.158665 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:10.159164 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:10.159972 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:10.160428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:10.295016 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:10.304184 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:10.305699 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:10.306919 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6f945dbd-5ebc-4492-9c89-00ace83dc94f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.160377 Apr 12 16:23:10.307503 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 355/703] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:10 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:10.821150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bf79409b-2851-4158-a3eb-d313966d8233 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "POST /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.006092 Apr 12 16:23:10.821760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 349/704] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:23:09 2022] POST /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d/os-volume_attachments => generated 194 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:11.331558 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:11.332152 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:11.338855 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:11.339311 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:11.340080 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:11.340510 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:11.480805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:11.491672 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:11.493161 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:11.494362 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-988a4fc5-c9df-484e-9fb4-8c4831198a70 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.168882 Apr 12 16:23:11.495121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 356/705] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:11 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:11.693603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-f7344ec3-70af-4acb-b573-824ab164aed1 req-1d598005-ba49-41bd-bd10-f8f04dc3f7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f48c36-5e37-4640-b589-df261265d809", "name": "network-vif-plugged", "status": "completed", "tag": "aaca632c-41bc-43f8-8889-7aea0e458ffa"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:11.702455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-f7344ec3-70af-4acb-b573-824ab164aed1 req-1d598005-ba49-41bd-bd10-f8f04dc3f7a2 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:11.703304 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-f7344ec3-70af-4acb-b573-824ab164aed1 req-1d598005-ba49-41bd-bd10-f8f04dc3f7a2 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:11.714888 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-f7344ec3-70af-4acb-b573-824ab164aed1 req-1d598005-ba49-41bd-bd10-f8f04dc3f7a2 service nova] Creating event network-vif-plugged:aaca632c-41bc-43f8-8889-7aea0e458ffa for instance 29f48c36-5e37-4640-b589-df261265d809 on hv-cinder-83752 Apr 12 16:23:11.720028 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-f7344ec3-70af-4acb-b573-824ab164aed1 req-1d598005-ba49-41bd-bd10-f8f04dc3f7a2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 Apr 12 16:23:11.720638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 350/706] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:23:12.517715 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:12.518320 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:12.525485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:12.526014 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:12.526846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:12.527309 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:12.671844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:12.680560 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:12.682071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:12.683250 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5f59727d-c452-48d0-83f5-b640ad38753c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.169985 Apr 12 16:23:12.683817 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 357/707] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:12 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:13.707187 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:13.707964 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:13.714791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:13.715254 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:13.716059 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:13.716529 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:13.852863 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:13.861960 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:13.863470 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:13.864629 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-48071372-9673-49c5-95b6-590828e07bac tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.165087 Apr 12 16:23:13.865185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 351/708] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:13 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:14.886382 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:14.887484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:14.897911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:14.898688 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:14.899855 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:14.900517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:15.041410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:15.050648 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:15.052146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:15.053319 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1c3c2d54-cda5-46ee-bbd2-a11928296d8f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.172840 Apr 12 16:23:15.054072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 358/709] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:14 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:16.076064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:16.076986 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:16.088697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:16.089442 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:16.090759 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:16.091495 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:16.232153 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:16.240855 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:16.242354 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:16.243497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1d09295e-92ab-461e-b1c1-d83eccac31b8 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.174129 Apr 12 16:23:16.244055 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 352/710] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:16 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:17.058530 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-75e2dcbe-a93b-4e95-bb83-df084a8e2fe3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:17.059415 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-75e2dcbe-a93b-4e95-bb83-df084a8e2fe3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:17.068145 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75e2dcbe-a93b-4e95-bb83-df084a8e2fe3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.068589 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75e2dcbe-a93b-4e95-bb83-df084a8e2fe3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.069358 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75e2dcbe-a93b-4e95-bb83-df084a8e2fe3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.069788 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75e2dcbe-a93b-4e95-bb83-df084a8e2fe3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.098691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-75e2dcbe-a93b-4e95-bb83-df084a8e2fe3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696/ips" status: 200 len: 151 microversion: 2.1 time: 0.046573 Apr 12 16:23:17.099232 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 359/711] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:23:17 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:17.117131 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b212363a-b28e-4e98-95c3-c6fcda23dcbf"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:17.119726 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:17.129943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.130433 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.131749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.131749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.209894 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Invalid volume: volume b212363a-b28e-4e98-95c3-c6fcda23dcbf is already attached to instances: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac Apr 12 16:23:17.210511 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 400 to user: Invalid volume: volume b212363a-b28e-4e98-95c3-c6fcda23dcbf is already attached to instances: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:23:17.211343 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ddd14324-17a5-4381-a8bf-eaab1984bf36 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104524 Apr 12 16:23:17.211925 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 353/712] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:23:17 2022] POST /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 12 16:23:17.220419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cc41fbdc-f04d-4092-9195-9a0a3762b8bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:17.220908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cc41fbdc-f04d-4092-9195-9a0a3762b8bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:17.226943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc41fbdc-f04d-4092-9195-9a0a3762b8bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.227392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc41fbdc-f04d-4092-9195-9a0a3762b8bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.228151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc41fbdc-f04d-4092-9195-9a0a3762b8bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.228585 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc41fbdc-f04d-4092-9195-9a0a3762b8bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.252716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cc41fbdc-f04d-4092-9195-9a0a3762b8bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:23:17.262085 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:17.262687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:17.269352 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.269794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.270591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.271074 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.328752 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cc41fbdc-f04d-4092-9195-9a0a3762b8bc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 204 len: 0 microversion: 2.1 time: 0.111844 Apr 12 16:23:17.329857 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 360/713] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:23:17 2022] DELETE /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:23:17.338220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8d2bcd87-f18f-4cdc-a446-f7fe207a176c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:17.338910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8d2bcd87-f18f-4cdc-a446-f7fe207a176c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:17.344580 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8d2bcd87-f18f-4cdc-a446-f7fe207a176c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.345239 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8d2bcd87-f18f-4cdc-a446-f7fe207a176c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.346011 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8d2bcd87-f18f-4cdc-a446-f7fe207a176c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:17.346474 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8d2bcd87-f18f-4cdc-a446-f7fe207a176c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:17.412479 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:17.421362 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:17.423416 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:17.424733 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d4b3cc4c-ff76-4bc1-805e-14c151951d5a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.166581 Apr 12 16:23:17.425533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 354/714] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:17 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:17.496605 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8d2bcd87-f18f-4cdc-a446-f7fe207a176c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:17.508435 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8d2bcd87-f18f-4cdc-a446-f7fe207a176c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1681 microversion: 2.1 time: 0.174109 Apr 12 16:23:17.509331 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 361/715] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:17 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:18.443798 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:18.444418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:18.451937 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:18.452465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:18.453305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:18.453778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:18.528523 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0fe5b6d1-aa7e-40be-abda-7ec9b241aeb4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:18.529149 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0fe5b6d1-aa7e-40be-abda-7ec9b241aeb4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:18.536114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0fe5b6d1-aa7e-40be-abda-7ec9b241aeb4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:18.536636 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0fe5b6d1-aa7e-40be-abda-7ec9b241aeb4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:18.537524 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0fe5b6d1-aa7e-40be-abda-7ec9b241aeb4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:18.537996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0fe5b6d1-aa7e-40be-abda-7ec9b241aeb4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:18.605764 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:18.615675 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:18.617164 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:18.618379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-60c1f05c-b089-4319-82e0-02d8077eba22 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.179179 Apr 12 16:23:18.618949 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 355/716] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:18 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:18.843812 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0fe5b6d1-aa7e-40be-abda-7ec9b241aeb4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:18.857717 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0fe5b6d1-aa7e-40be-abda-7ec9b241aeb4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1681 microversion: 2.1 time: 0.332716 Apr 12 16:23:18.858453 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 362/717] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:18 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1681 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:19.641172 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:19.642202 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:19.649662 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:19.650207 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:19.651075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:19.651561 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:19.809816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:19.819074 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:19.820553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:19.821705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c60bf8bf-624e-4bd2-aa71-89a58d082e8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.187020 Apr 12 16:23:19.822650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 356/718] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:19 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:19.876877 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cc649184-690a-401f-ab1a-e83f06c002dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:19.877537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cc649184-690a-401f-ab1a-e83f06c002dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:19.884550 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc649184-690a-401f-ab1a-e83f06c002dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:19.885013 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc649184-690a-401f-ab1a-e83f06c002dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:19.885779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc649184-690a-401f-ab1a-e83f06c002dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:19.886248 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cc649184-690a-401f-ab1a-e83f06c002dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:20.016261 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cc649184-690a-401f-ab1a-e83f06c002dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:20.024559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cc649184-690a-401f-ab1a-e83f06c002dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1681 microversion: 2.1 time: 0.151773 Apr 12 16:23:20.025123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 363/719] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:19 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:20.849769 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:20.850698 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:20.859646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:20.860295 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:20.861174 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:20.861724 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:21.004011 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:21.016770 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:21.018309 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:21.019462 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9a935765-6010-43e6-9025-b7cb9721bc74 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1808 microversion: 2.20 time: 0.175925 Apr 12 16:23:21.020054 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 357/720] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:20 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:21.042148 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d74fabf8-59e2-4b26-a247-75e40fc2224f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:21.042672 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d74fabf8-59e2-4b26-a247-75e40fc2224f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:21.049601 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d74fabf8-59e2-4b26-a247-75e40fc2224f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:21.050070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d74fabf8-59e2-4b26-a247-75e40fc2224f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:21.050861 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d74fabf8-59e2-4b26-a247-75e40fc2224f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:21.051295 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d74fabf8-59e2-4b26-a247-75e40fc2224f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:21.185024 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d74fabf8-59e2-4b26-a247-75e40fc2224f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:21.196515 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d74fabf8-59e2-4b26-a247-75e40fc2224f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1681 microversion: 2.1 time: 0.158078 Apr 12 16:23:21.197263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 364/721] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:21 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:22.041379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:22.042372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:22.051242 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:22.051716 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:22.052497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:22.052955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:22.216875 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0836b587-cbfd-4ea4-b7da-d0bc39190762 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:22.217484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0836b587-cbfd-4ea4-b7da-d0bc39190762 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:22.224282 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0836b587-cbfd-4ea4-b7da-d0bc39190762 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:22.224727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0836b587-cbfd-4ea4-b7da-d0bc39190762 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:22.225514 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0836b587-cbfd-4ea4-b7da-d0bc39190762 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:22.225947 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0836b587-cbfd-4ea4-b7da-d0bc39190762 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:22.229450 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:22.237983 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:22.239722 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:22.240868 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-aa884d0d-6029-45ae-9d0e-9117dcc080be tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1795 microversion: 2.20 time: 0.206117 Apr 12 16:23:22.241412 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 358/722] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:23:22 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1795 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:23:22.369712 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0836b587-cbfd-4ea4-b7da-d0bc39190762 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:22.380375 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0836b587-cbfd-4ea4-b7da-d0bc39190762 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1681 microversion: 2.1 time: 0.167453 Apr 12 16:23:22.380945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 365/723] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:22 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:23.398015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ae000d44-6552-4370-8c70-b93329150157 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:23.398667 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ae000d44-6552-4370-8c70-b93329150157 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:23.405178 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ae000d44-6552-4370-8c70-b93329150157 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:23.405636 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ae000d44-6552-4370-8c70-b93329150157 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:23.406439 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ae000d44-6552-4370-8c70-b93329150157 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:23.406974 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ae000d44-6552-4370-8c70-b93329150157 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:23.496672 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ae000d44-6552-4370-8c70-b93329150157 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:23.506557 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ae000d44-6552-4370-8c70-b93329150157 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1613 microversion: 2.1 time: 0.112424 Apr 12 16:23:23.514630 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 359/724] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:23 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:23.716389 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-7ba34573-d449-4837-aa4b-faf6bc92759b req-1dcd7595-8649-469c-8fbf-a59a6a9addf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06dc15d1-6e23-4515-9016-40ecb0211696", "name": "network-vif-deleted", "tag": "f49f49e8-9e2c-413a-9e10-638937a3802d"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:23.725775 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-7ba34573-d449-4837-aa4b-faf6bc92759b req-1dcd7595-8649-469c-8fbf-a59a6a9addf8 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:23.726184 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-7ba34573-d449-4837-aa4b-faf6bc92759b req-1dcd7595-8649-469c-8fbf-a59a6a9addf8 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:23.737103 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-7ba34573-d449-4837-aa4b-faf6bc92759b req-1dcd7595-8649-469c-8fbf-a59a6a9addf8 service nova] Creating event network-vif-deleted:f49f49e8-9e2c-413a-9e10-638937a3802d for instance 06dc15d1-6e23-4515-9016-40ecb0211696 on hv-cinder-83752 Apr 12 16:23:23.742524 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-7ba34573-d449-4837-aa4b-faf6bc92759b req-1dcd7595-8649-469c-8fbf-a59a6a9addf8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Apr 12 16:23:23.743263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 366/725] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:24.523871 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:24.524476 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:24.531426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:24.532311 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:24.532760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:24.533164 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:24.565494 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:24.565923 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:24.566436 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'fault' on Instance uuid 06dc15d1-6e23-4515-9016-40ecb0211696 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:23:24.612240 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:24.620946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-be0de86f-1b40-463d-b17f-6e8e3c25909e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1329 microversion: 2.1 time: 0.100951 Apr 12 16:23:24.621535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 360/726] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:24 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:25.640165 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:25.640916 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:25.648185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:25.648635 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:25.649402 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:25.649832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:25.683678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:25.684120 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:25.684576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'fault' on Instance uuid 06dc15d1-6e23-4515-9016-40ecb0211696 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:23:25.729251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:25.737522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1a3e19d5-2da6-4611-92c8-3dafbc6ef4dc tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1329 microversion: 2.1 time: 0.101660 Apr 12 16:23:25.738149 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 367/727] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:25 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:26.755126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:26.755740 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:26.762771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:26.763227 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:26.764035 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:26.764471 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:26.795573 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:26.796024 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:26.796473 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'fault' on Instance uuid 06dc15d1-6e23-4515-9016-40ecb0211696 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:23:26.851553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:26.862609 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-36ee03c4-b20a-43d8-9a5e-e29a43158317 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1329 microversion: 2.1 time: 0.111047 Apr 12 16:23:26.863479 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 361/728] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:26 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:27.879698 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:27.880295 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:27.886875 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:27.887330 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:27.888183 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:27.888623 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:27.921175 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:27.921624 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:27.922073 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'fault' on Instance uuid 06dc15d1-6e23-4515-9016-40ecb0211696 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:23:27.963961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:27.972268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a5851938-9f33-4115-a609-c5a4909cf113 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 200 len: 1329 microversion: 2.1 time: 0.096492 Apr 12 16:23:27.972895 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 368/729] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:27 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:28.995400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:28.996109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:29.002343 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:29.003168 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:29.004178 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:29.004864 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:29.047469 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 06dc15d1-6e23-4515-9016-40ecb0211696 could not be found. Apr 12 16:23:29.049649 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 06dc15d1-6e23-4515-9016-40ecb0211696 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:23:29.052788 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a974fac1-20cc-4a74-8a43-dd1edb33fa4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 404 len: 111 microversion: 2.1 time: 0.060679 Apr 12 16:23:29.057647 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 362/730] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:28 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:29.067451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c256d9f1-3312-442b-9665-efe7dee0cfac tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '.version_select at 0x7f246dc14b80>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:29.075109 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c256d9f1-3312-442b-9665-efe7dee0cfac tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [9e9999d4-2fbc-4ba2-9a55-c73a26e5a3e5] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 16:23:30.087007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO oslo.messaging._drivers.impl_rabbit [None req-c256d9f1-3312-442b-9665-efe7dee0cfac tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [9e9999d4-2fbc-4ba2-9a55-c73a26e5a3e5] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 47646. Apr 12 16:23:30.113991 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c256d9f1-3312-442b-9665-efe7dee0cfac tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-56275195" status: 202 len: 0 microversion: 2.1 time: 1.054455 Apr 12 16:23:30.114610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 369/731] 10.222.0.67 () {58 vars in 1214 bytes} [Tue Apr 12 16:23:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-56275195 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:23:30.849977 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1263f676-b1a9-4af7-9c21-81517ef5ac92 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:30.850538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1263f676-b1a9-4af7-9c21-81517ef5ac92 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:30.857015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1263f676-b1a9-4af7-9c21-81517ef5ac92 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:30.857469 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1263f676-b1a9-4af7-9c21-81517ef5ac92 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:30.858280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1263f676-b1a9-4af7-9c21-81517ef5ac92 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:30.858715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1263f676-b1a9-4af7-9c21-81517ef5ac92 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:31.114359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-1263f676-b1a9-4af7-9c21-81517ef5ac92 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'services' on Instance uuid 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:23:31.231106 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1263f676-b1a9-4af7-9c21-81517ef5ac92 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments/b212363a-b28e-4e98-95c3-c6fcda23dcbf" status: 202 len: 0 microversion: 2.1 time: 0.384838 Apr 12 16:23:31.231794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 363/732] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:23:30 2022] DELETE /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments/b212363a-b28e-4e98-95c3-c6fcda23dcbf => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:23:31.241171 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1a1f09c6-9513-4e01-a26b-6ea7f0a4c8e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:31.242124 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1a1f09c6-9513-4e01-a26b-6ea7f0a4c8e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:31.249194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a1f09c6-9513-4e01-a26b-6ea7f0a4c8e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:31.249643 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a1f09c6-9513-4e01-a26b-6ea7f0a4c8e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:31.251149 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a1f09c6-9513-4e01-a26b-6ea7f0a4c8e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:31.251753 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a1f09c6-9513-4e01-a26b-6ea7f0a4c8e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:31.283681 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1a1f09c6-9513-4e01-a26b-6ea7f0a4c8e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046443 Apr 12 16:23:31.284321 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 370/733] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:23:31 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:23:32.297322 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-24116544-e997-45c4-b374-1e1d1a28594c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:32.298495 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-24116544-e997-45c4-b374-1e1d1a28594c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:32.305747 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-24116544-e997-45c4-b374-1e1d1a28594c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:32.306247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-24116544-e997-45c4-b374-1e1d1a28594c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:32.307033 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-24116544-e997-45c4-b374-1e1d1a28594c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:32.307448 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-24116544-e997-45c4-b374-1e1d1a28594c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:32.338025 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-24116544-e997-45c4-b374-1e1d1a28594c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Apr 12 16:23:32.338634 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 364/734] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:23:32 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:33.351165 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-64269e44-7ec6-41fa-9f75-672c0088cebd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:33.352004 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-64269e44-7ec6-41fa-9f75-672c0088cebd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:33.361922 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-64269e44-7ec6-41fa-9f75-672c0088cebd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:33.362687 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-64269e44-7ec6-41fa-9f75-672c0088cebd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:33.363921 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-64269e44-7ec6-41fa-9f75-672c0088cebd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:33.364652 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-64269e44-7ec6-41fa-9f75-672c0088cebd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:33.398566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-64269e44-7ec6-41fa-9f75-672c0088cebd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051947 Apr 12 16:23:33.399142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 371/735] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:23:33 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:33.588286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1216caa9-6358-4558-b322-72ddd232daf9 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:33.588881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1216caa9-6358-4558-b322-72ddd232daf9 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:33.595913 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1216caa9-6358-4558-b322-72ddd232daf9 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:33.596408 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1216caa9-6358-4558-b322-72ddd232daf9 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:33.597177 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1216caa9-6358-4558-b322-72ddd232daf9 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:33.597613 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1216caa9-6358-4558-b322-72ddd232daf9 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:33.688651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-1216caa9-6358-4558-b322-72ddd232daf9 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lazy-loading 'services' on Instance uuid 23749e20-689d-41b3-b798-49c86d90ae20 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:23:33.771316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1216caa9-6358-4558-b322-72ddd232daf9 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/os-volume_attachments/e1553ba8-c3f0-428c-8c3b-eeb90b64add3" status: 202 len: 0 microversion: 2.1 time: 0.186958 Apr 12 16:23:33.771949 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 365/736] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:23:33 2022] DELETE /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/os-volume_attachments/e1553ba8-c3f0-428c-8c3b-eeb90b64add3 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:23:34.409969 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-942adc9d-7eb5-46ab-87a5-96707ccf52e3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:34.410935 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-942adc9d-7eb5-46ab-87a5-96707ccf52e3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:34.417406 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-942adc9d-7eb5-46ab-87a5-96707ccf52e3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:34.417860 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-942adc9d-7eb5-46ab-87a5-96707ccf52e3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:34.418681 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-942adc9d-7eb5-46ab-87a5-96707ccf52e3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:34.419121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-942adc9d-7eb5-46ab-87a5-96707ccf52e3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:34.448651 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-942adc9d-7eb5-46ab-87a5-96707ccf52e3 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042730 Apr 12 16:23:34.449465 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 372/737] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:23:34 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:35.463826 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-85f14bf6-ac8c-4251-90b1-507e84b7ae55 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:35.465084 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-85f14bf6-ac8c-4251-90b1-507e84b7ae55 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:35.473618 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85f14bf6-ac8c-4251-90b1-507e84b7ae55 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:35.474320 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85f14bf6-ac8c-4251-90b1-507e84b7ae55 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:35.475510 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85f14bf6-ac8c-4251-90b1-507e84b7ae55 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:35.476083 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85f14bf6-ac8c-4251-90b1-507e84b7ae55 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:35.509448 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-85f14bf6-ac8c-4251-90b1-507e84b7ae55 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051834 Apr 12 16:23:35.510009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 366/738] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:23:35 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:23:35.573430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5dd3461e-42b7-484c-aa43-51dd349285b8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:35.574064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5dd3461e-42b7-484c-aa43-51dd349285b8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:35.584358 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5dd3461e-42b7-484c-aa43-51dd349285b8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:35.585668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5dd3461e-42b7-484c-aa43-51dd349285b8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:35.587417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5dd3461e-42b7-484c-aa43-51dd349285b8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:35.588033 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5dd3461e-42b7-484c-aa43-51dd349285b8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:35.626271 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5dd3461e-42b7-484c-aa43-51dd349285b8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:23:35.709282 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5dd3461e-42b7-484c-aa43-51dd349285b8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 204 len: 0 microversion: 2.1 time: 0.139475 Apr 12 16:23:35.709770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 373/739] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:23:35 2022] DELETE /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:23:35.718151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8c11fff1-91f1-43af-b868-a456d74f5f70 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:35.718809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8c11fff1-91f1-43af-b868-a456d74f5f70 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:35.725353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c11fff1-91f1-43af-b868-a456d74f5f70 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:35.725799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c11fff1-91f1-43af-b868-a456d74f5f70 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:35.726624 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c11fff1-91f1-43af-b868-a456d74f5f70 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:35.727058 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8c11fff1-91f1-43af-b868-a456d74f5f70 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:35.952259 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4be6f359-c842-44fd-9cf0-cd2cd2d63db2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:35.960149 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4be6f359-c842-44fd-9cf0-cd2cd2d63db2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:35.960671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4be6f359-c842-44fd-9cf0-cd2cd2d63db2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:35.985768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4be6f359-c842-44fd-9cf0-cd2cd2d63db2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Going to try to stop instance {{(pid=117202) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 12 16:23:36.033989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8c11fff1-91f1-43af-b868-a456d74f5f70 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:36.040243 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4be6f359-c842-44fd-9cf0-cd2cd2d63db2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/action" status: 202 len: 0 microversion: 2.1 time: 0.092776 Apr 12 16:23:36.040849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 374/740] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:23:35 2022] POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:23:36.044147 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8c11fff1-91f1-43af-b868-a456d74f5f70 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1678 microversion: 2.1 time: 0.329583 Apr 12 16:23:36.044935 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 367/741] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:35 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1678 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:36.049669 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-82099632-4ac1-4450-85b4-19a10d73797d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:36.050395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-82099632-4ac1-4450-85b4-19a10d73797d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:36.056973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-82099632-4ac1-4450-85b4-19a10d73797d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:36.057436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-82099632-4ac1-4450-85b4-19a10d73797d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:36.058257 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-82099632-4ac1-4450-85b4-19a10d73797d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:36.058693 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-82099632-4ac1-4450-85b4-19a10d73797d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:36.283263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-82099632-4ac1-4450-85b4-19a10d73797d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:36.294421 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-82099632-4ac1-4450-85b4-19a10d73797d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.248638 Apr 12 16:23:36.295083 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 375/742] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:36 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:37.066960 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b2abaed0-501c-401e-bedd-6ab30afcbe0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:37.067557 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b2abaed0-501c-401e-bedd-6ab30afcbe0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:37.074293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b2abaed0-501c-401e-bedd-6ab30afcbe0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:37.074744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b2abaed0-501c-401e-bedd-6ab30afcbe0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:37.075510 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b2abaed0-501c-401e-bedd-6ab30afcbe0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:37.075988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b2abaed0-501c-401e-bedd-6ab30afcbe0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:37.232650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b2abaed0-501c-401e-bedd-6ab30afcbe0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:37.242091 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b2abaed0-501c-401e-bedd-6ab30afcbe0b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1678 microversion: 2.1 time: 0.179460 Apr 12 16:23:37.242659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 368/743] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:37 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:37.312720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a2e9ef38-f202-43c9-84a5-37e376db559d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:37.313452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a2e9ef38-f202-43c9-84a5-37e376db559d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:37.320553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a2e9ef38-f202-43c9-84a5-37e376db559d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:37.320933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a2e9ef38-f202-43c9-84a5-37e376db559d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:37.321703 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a2e9ef38-f202-43c9-84a5-37e376db559d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:37.322177 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a2e9ef38-f202-43c9-84a5-37e376db559d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:37.569869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5f4c80f4-5698-4f4f-831c-c7ec9351f45d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:37.570400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5f4c80f4-5698-4f4f-831c-c7ec9351f45d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:37.576895 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5f4c80f4-5698-4f4f-831c-c7ec9351f45d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:37.577253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5f4c80f4-5698-4f4f-831c-c7ec9351f45d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:37.578024 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5f4c80f4-5698-4f4f-831c-c7ec9351f45d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:37.578616 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5f4c80f4-5698-4f4f-831c-c7ec9351f45d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:37.663262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-5f4c80f4-5698-4f4f-831c-c7ec9351f45d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lazy-loading 'services' on Instance uuid 66e1eb9a-45b4-4544-9f82-0af5e1705f6d {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:23:37.723007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a2e9ef38-f202-43c9-84a5-37e376db559d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:37.733838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a2e9ef38-f202-43c9-84a5-37e376db559d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1722 microversion: 2.1 time: 0.425081 Apr 12 16:23:37.734657 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 376/744] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:37 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:37.740813 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5f4c80f4-5698-4f4f-831c-c7ec9351f45d tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "DELETE /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d/os-volume_attachments/3369e213-e5be-4365-9340-ff4c08398e3e" status: 202 len: 0 microversion: 2.1 time: 0.174854 Apr 12 16:23:37.741419 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 369/745] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:23:37 2022] DELETE /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d/os-volume_attachments/3369e213-e5be-4365-9340-ff4c08398e3e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:23:38.261863 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6f5617ca-ba2a-4609-b814-5af0e8d4b8de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:38.262634 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6f5617ca-ba2a-4609-b814-5af0e8d4b8de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:38.269882 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f5617ca-ba2a-4609-b814-5af0e8d4b8de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:38.270361 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f5617ca-ba2a-4609-b814-5af0e8d4b8de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:38.271146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f5617ca-ba2a-4609-b814-5af0e8d4b8de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:38.271587 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f5617ca-ba2a-4609-b814-5af0e8d4b8de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:38.412326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6f5617ca-ba2a-4609-b814-5af0e8d4b8de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:38.419815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6f5617ca-ba2a-4609-b814-5af0e8d4b8de tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1678 microversion: 2.1 time: 0.162713 Apr 12 16:23:38.420378 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 377/746] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:38 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:38.753858 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-45cc4260-20b2-4c83-8e57-b35001f04697 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:38.754596 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-45cc4260-20b2-4c83-8e57-b35001f04697 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:38.761121 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45cc4260-20b2-4c83-8e57-b35001f04697 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:38.761742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45cc4260-20b2-4c83-8e57-b35001f04697 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:38.762568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45cc4260-20b2-4c83-8e57-b35001f04697 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:38.762988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45cc4260-20b2-4c83-8e57-b35001f04697 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:38.914659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45cc4260-20b2-4c83-8e57-b35001f04697 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:38.924786 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-45cc4260-20b2-4c83-8e57-b35001f04697 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.176301 Apr 12 16:23:38.925504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 370/747] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:38 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:39.438877 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bfc95be6-5fd6-411e-9694-cc9b95fe5261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:39.439670 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bfc95be6-5fd6-411e-9694-cc9b95fe5261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:39.446977 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bfc95be6-5fd6-411e-9694-cc9b95fe5261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:39.447532 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bfc95be6-5fd6-411e-9694-cc9b95fe5261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:39.448400 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bfc95be6-5fd6-411e-9694-cc9b95fe5261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:39.448916 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bfc95be6-5fd6-411e-9694-cc9b95fe5261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:39.663201 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bfc95be6-5fd6-411e-9694-cc9b95fe5261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:39.671131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bfc95be6-5fd6-411e-9694-cc9b95fe5261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1678 microversion: 2.1 time: 0.237103 Apr 12 16:23:39.671722 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 378/748] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:39 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:39.916097 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5117a574-fdea-4ea3-bb64-3a3d8fbd2323 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:39.916680 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5117a574-fdea-4ea3-bb64-3a3d8fbd2323 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:39.923230 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5117a574-fdea-4ea3-bb64-3a3d8fbd2323 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:39.923676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5117a574-fdea-4ea3-bb64-3a3d8fbd2323 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:39.924444 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5117a574-fdea-4ea3-bb64-3a3d8fbd2323 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:39.924874 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5117a574-fdea-4ea3-bb64-3a3d8fbd2323 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:39.947087 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3ed8a948-b000-4645-81f0-34a811c64c34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:39.947979 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3ed8a948-b000-4645-81f0-34a811c64c34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:39.950996 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5117a574-fdea-4ea3-bb64-3a3d8fbd2323 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Going to try to terminate instance {{(pid=117201) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:23:39.954677 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ed8a948-b000-4645-81f0-34a811c64c34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:39.955139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ed8a948-b000-4645-81f0-34a811c64c34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:39.955923 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ed8a948-b000-4645-81f0-34a811c64c34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:39.956362 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ed8a948-b000-4645-81f0-34a811c64c34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:40.029361 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5117a574-fdea-4ea3-bb64-3a3d8fbd2323 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "DELETE /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 204 len: 0 microversion: 2.1 time: 0.116946 Apr 12 16:23:40.030160 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 371/749] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:23:39 2022] DELETE /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:23:40.040865 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-74b6f792-806b-4317-88d3-4ccf895ab4cd tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:40.041622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-74b6f792-806b-4317-88d3-4ccf895ab4cd tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:40.047833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-74b6f792-806b-4317-88d3-4ccf895ab4cd tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:40.048357 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-74b6f792-806b-4317-88d3-4ccf895ab4cd tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:40.049201 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-74b6f792-806b-4317-88d3-4ccf895ab4cd tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:40.049645 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-74b6f792-806b-4317-88d3-4ccf895ab4cd tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:40.241048 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3ed8a948-b000-4645-81f0-34a811c64c34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:40.253022 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3ed8a948-b000-4645-81f0-34a811c64c34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.309932 Apr 12 16:23:40.254366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 379/750] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:39 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:40.285950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-c3e506e7-6581-47b4-8b4a-57c9f3f23df0 req-c0d04eaa-6f67-40ff-8d08-f94fddc992aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac", "name": "network-vif-deleted", "tag": "150e9cf9-34e1-43bb-8678-6b019f683dc6"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:40.296127 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-c3e506e7-6581-47b4-8b4a-57c9f3f23df0 req-c0d04eaa-6f67-40ff-8d08-f94fddc992aa service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:40.297153 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-c3e506e7-6581-47b4-8b4a-57c9f3f23df0 req-c0d04eaa-6f67-40ff-8d08-f94fddc992aa service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:40.302911 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-74b6f792-806b-4317-88d3-4ccf895ab4cd tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:40.312662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-c3e506e7-6581-47b4-8b4a-57c9f3f23df0 req-c0d04eaa-6f67-40ff-8d08-f94fddc992aa service nova] Creating event network-vif-deleted:150e9cf9-34e1-43bb-8678-6b019f683dc6 for instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac on hv-cinder-83752 Apr 12 16:23:40.315429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-74b6f792-806b-4317-88d3-4ccf895ab4cd tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1512 microversion: 2.1 time: 0.280513 Apr 12 16:23:40.330838 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 372/751] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:40 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1512 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:40.334973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-c3e506e7-6581-47b4-8b4a-57c9f3f23df0 req-c0d04eaa-6f67-40ff-8d08-f94fddc992aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053740 Apr 12 16:23:40.335913 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 380/752] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:23:40.689317 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-aede69f6-951f-4a68-99d8-6dee54f1b3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:40.689945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-aede69f6-951f-4a68-99d8-6dee54f1b3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:40.696183 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aede69f6-951f-4a68-99d8-6dee54f1b3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:40.696652 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aede69f6-951f-4a68-99d8-6dee54f1b3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:40.697409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aede69f6-951f-4a68-99d8-6dee54f1b3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:40.697838 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aede69f6-951f-4a68-99d8-6dee54f1b3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:40.760654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aede69f6-951f-4a68-99d8-6dee54f1b3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:40.768973 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-aede69f6-951f-4a68-99d8-6dee54f1b3e4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1611 microversion: 2.1 time: 0.083928 Apr 12 16:23:40.769555 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 373/753] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:40 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1611 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:41.273795 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ae8bc1e5-73ba-4139-ae79-30d908a6d4b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:41.274562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ae8bc1e5-73ba-4139-ae79-30d908a6d4b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:41.281695 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae8bc1e5-73ba-4139-ae79-30d908a6d4b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:41.282154 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae8bc1e5-73ba-4139-ae79-30d908a6d4b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:41.283013 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae8bc1e5-73ba-4139-ae79-30d908a6d4b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:41.283476 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae8bc1e5-73ba-4139-ae79-30d908a6d4b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:41.341250 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-18fda8c3-f181-4f27-9224-febc036701df tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:41.341864 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-18fda8c3-f181-4f27-9224-febc036701df tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:41.348955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18fda8c3-f181-4f27-9224-febc036701df tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:41.349411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18fda8c3-f181-4f27-9224-febc036701df tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:41.350248 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18fda8c3-f181-4f27-9224-febc036701df tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:41.350710 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-18fda8c3-f181-4f27-9224-febc036701df tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:41.469894 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ae8bc1e5-73ba-4139-ae79-30d908a6d4b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:41.477609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ae8bc1e5-73ba-4139-ae79-30d908a6d4b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.209168 Apr 12 16:23:41.478454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 381/754] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:41 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:41.514670 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-18fda8c3-f181-4f27-9224-febc036701df tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:41.522791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-18fda8c3-f181-4f27-9224-febc036701df tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1512 microversion: 2.1 time: 0.185454 Apr 12 16:23:41.523353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 374/755] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:41 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:41.902600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1a0f82e9-1e8f-4748-b5c3-db06f3fa881d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:41.903228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1a0f82e9-1e8f-4748-b5c3-db06f3fa881d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:41.910000 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a0f82e9-1e8f-4748-b5c3-db06f3fa881d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:41.910503 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a0f82e9-1e8f-4748-b5c3-db06f3fa881d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:41.911281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a0f82e9-1e8f-4748-b5c3-db06f3fa881d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:41.911717 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1a0f82e9-1e8f-4748-b5c3-db06f3fa881d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:41.978651 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1a0f82e9-1e8f-4748-b5c3-db06f3fa881d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:41.989326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1a0f82e9-1e8f-4748-b5c3-db06f3fa881d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1611 microversion: 2.1 time: 0.206552 Apr 12 16:23:41.989913 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 382/756] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:41 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1611 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:42.498819 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-eb99f129-fbe3-4fe2-92ce-08dd5722d3ef tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:42.499418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-eb99f129-fbe3-4fe2-92ce-08dd5722d3ef tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:42.506307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb99f129-fbe3-4fe2-92ce-08dd5722d3ef tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:42.506768 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb99f129-fbe3-4fe2-92ce-08dd5722d3ef tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:42.507560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb99f129-fbe3-4fe2-92ce-08dd5722d3ef tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:42.508007 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb99f129-fbe3-4fe2-92ce-08dd5722d3ef tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:42.540352 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-035b902e-b88d-4835-af24-c15f672f5e26 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:42.541040 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-035b902e-b88d-4835-af24-c15f672f5e26 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:42.547592 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-035b902e-b88d-4835-af24-c15f672f5e26 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:42.548138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-035b902e-b88d-4835-af24-c15f672f5e26 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:42.549121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-035b902e-b88d-4835-af24-c15f672f5e26 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:42.549562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-035b902e-b88d-4835-af24-c15f672f5e26 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:42.694684 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-eb99f129-fbe3-4fe2-92ce-08dd5722d3ef tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:42.702454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-eb99f129-fbe3-4fe2-92ce-08dd5722d3ef tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.209356 Apr 12 16:23:42.703267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 375/757] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:42 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:42.720871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-035b902e-b88d-4835-af24-c15f672f5e26 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:42.729519 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-035b902e-b88d-4835-af24-c15f672f5e26 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1512 microversion: 2.1 time: 0.193057 Apr 12 16:23:42.730102 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 383/758] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:42 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:43.008327 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:43.008876 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:43.016639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:43.017143 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:43.017940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:43.018409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:43.063665 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:43.064111 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:43.064566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'fault' on Instance uuid 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:23:43.118187 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:43.125965 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4f217a98-d841-4358-9fc7-7384a860710d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 200 len: 1328 microversion: 2.1 time: 0.122376 Apr 12 16:23:43.126576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 376/759] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:43 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:43.721683 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bb13026d-bea8-4801-a62c-699ea8c070cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:43.722220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bb13026d-bea8-4801-a62c-699ea8c070cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:43.729199 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bb13026d-bea8-4801-a62c-699ea8c070cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:43.729906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bb13026d-bea8-4801-a62c-699ea8c070cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:43.730715 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bb13026d-bea8-4801-a62c-699ea8c070cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:43.731146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bb13026d-bea8-4801-a62c-699ea8c070cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:43.746869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0b6c1972-b45a-4189-97ec-bc7381448996 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:43.748597 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0b6c1972-b45a-4189-97ec-bc7381448996 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:43.756315 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b6c1972-b45a-4189-97ec-bc7381448996 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:43.757064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b6c1972-b45a-4189-97ec-bc7381448996 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:43.758583 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b6c1972-b45a-4189-97ec-bc7381448996 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:43.759255 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b6c1972-b45a-4189-97ec-bc7381448996 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:43.869275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0b6c1972-b45a-4189-97ec-bc7381448996 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63ecebba0d84bd7a2dc6e1f8b152001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cca5abe3a804deeb910d0d5920c6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:43.877590 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0b6c1972-b45a-4189-97ec-bc7381448996 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 200 len: 1470 microversion: 2.1 time: 0.134828 Apr 12 16:23:43.877973 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 377/760] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:43 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 1470 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:43.883488 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-2f3289d8-6db7-4747-b3ea-075aadd78ab4 req-fb9f5d80-e95a-48d8-a8db-7cad02cbb2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e1eb9a-45b4-4544-9f82-0af5e1705f6d", "name": "network-vif-deleted", "tag": "3f75fe13-2bb9-45aa-b722-a916232b255c"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:43.892681 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2f3289d8-6db7-4747-b3ea-075aadd78ab4 req-fb9f5d80-e95a-48d8-a8db-7cad02cbb2f4 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:43.894492 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2f3289d8-6db7-4747-b3ea-075aadd78ab4 req-fb9f5d80-e95a-48d8-a8db-7cad02cbb2f4 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:43.907658 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-2f3289d8-6db7-4747-b3ea-075aadd78ab4 req-fb9f5d80-e95a-48d8-a8db-7cad02cbb2f4 service nova] Creating event network-vif-deleted:3f75fe13-2bb9-45aa-b722-a916232b255c for instance 66e1eb9a-45b4-4544-9f82-0af5e1705f6d on hv-cinder-83752 Apr 12 16:23:43.914375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-2f3289d8-6db7-4747-b3ea-075aadd78ab4 req-fb9f5d80-e95a-48d8-a8db-7cad02cbb2f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033515 Apr 12 16:23:43.914375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 378/761] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:43.954730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bb13026d-bea8-4801-a62c-699ea8c070cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:43.962618 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bb13026d-bea8-4801-a62c-699ea8c070cb tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.245069 Apr 12 16:23:43.963234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 384/762] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:43 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:44.144157 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:44.144844 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:44.151250 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:44.151697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:44.152497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:44.152914 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:44.168384 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac could not be found. Apr 12 16:23:44.168958 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:23:44.169795 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-cadf9c34-240c-4cec-b840-7a497095731b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 404 len: 111 microversion: 2.1 time: 0.030215 Apr 12 16:23:44.170372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 379/763] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:44 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:44.180954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-48ffce22-ed52-4429-bd68-2d3753cae467 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '.version_select at 0x7f246dbe4700>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:44.203499 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-48ffce22-ed52-4429-bd68-2d3753cae467 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-8788159" status: 202 len: 0 microversion: 2.1 time: 0.027421 Apr 12 16:23:44.204461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 385/764] 10.222.0.67 () {58 vars in 1211 bytes} [Tue Apr 12 16:23:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-8788159 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:23:44.894963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:44.895583 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] [instance: 66e1eb9a-45b4-4544-9f82-0af5e1705f6d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:44.902856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:44.903217 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:44.904256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:44.904709 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:44.910143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7924bb5b-5c6c-4b15-8818-f9ab98257191 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: .version_select at 0x7f246db37940>, body: {"keypair": {"name": "tempest-keypair-1422773554"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:44.918760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] HTTP exception thrown: Instance 66e1eb9a-45b4-4544-9f82-0af5e1705f6d could not be found. Apr 12 16:23:44.919402 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] Returning 404 to user: Instance 66e1eb9a-45b4-4544-9f82-0af5e1705f6d could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:23:44.920185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3444461d-481b-4e9f-8883-6a8ba2048e16 tempest-VolumesSnapshotTestJSON-631066027 tempest-VolumesSnapshotTestJSON-631066027-project] 10.222.0.67 "GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d" status: 404 len: 111 microversion: 2.1 time: 0.029256 Apr 12 16:23:44.920914 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 380/765] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:44 2022] GET /compute/v2.1/servers/66e1eb9a-45b4-4544-9f82-0af5e1705f6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:23:44.924382 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-7924bb5b-5c6c-4b15-8818-f9ab98257191 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:23:44.930201 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-7924bb5b-5c6c-4b15-8818-f9ab98257191 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:23:44.980466 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c900d82c-110d-4953-b666-f3066308afa5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:44.981080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c900d82c-110d-4953-b666-f3066308afa5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:44.987455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c900d82c-110d-4953-b666-f3066308afa5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:44.987919 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c900d82c-110d-4953-b666-f3066308afa5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:44.988686 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c900d82c-110d-4953-b666-f3066308afa5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:44.989291 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c900d82c-110d-4953-b666-f3066308afa5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:45.129638 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c900d82c-110d-4953-b666-f3066308afa5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:45.139471 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c900d82c-110d-4953-b666-f3066308afa5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.162870 Apr 12 16:23:45.140049 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 381/766] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:44 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:45.511773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-7924bb5b-5c6c-4b15-8818-f9ab98257191 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:23:45.515486 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-7924bb5b-5c6c-4b15-8818-f9ab98257191 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:23:45.529142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7924bb5b-5c6c-4b15-8818-f9ab98257191 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.623837 Apr 12 16:23:45.529930 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 386/767] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:23:44 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:46.159776 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-086208e7-22ca-4f66-9b18-4a528c20c73d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:46.160391 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-086208e7-22ca-4f66-9b18-4a528c20c73d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:46.167145 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-086208e7-22ca-4f66-9b18-4a528c20c73d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:46.167601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-086208e7-22ca-4f66-9b18-4a528c20c73d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:46.168387 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-086208e7-22ca-4f66-9b18-4a528c20c73d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:46.168835 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-086208e7-22ca-4f66-9b18-4a528c20c73d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:46.373521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-086208e7-22ca-4f66-9b18-4a528c20c73d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:46.382401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-086208e7-22ca-4f66-9b18-4a528c20c73d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.226816 Apr 12 16:23:46.383220 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 382/768] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:46 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:46.912725 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1789594208", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ecce0ebb-6f6d-41f3-91d1-6cb5caa3527a"}], "security_groups": [{"name": "tempest-securitygroup--470042977"}], "key_name": "tempest-keypair-1422773554", "user_data": "}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:47.018230 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] validate_networks() for [('ecce0ebb-6f6d-41f3-91d1-6cb5caa3527a', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:23:47.400251 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-488929ad-6f42-4b61-bf13-4e0e2e2e5b5b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:47.400816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-488929ad-6f42-4b61-bf13-4e0e2e2e5b5b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:47.407959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-488929ad-6f42-4b61-bf13-4e0e2e2e5b5b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:47.408465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-488929ad-6f42-4b61-bf13-4e0e2e2e5b5b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:47.409253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-488929ad-6f42-4b61-bf13-4e0e2e2e5b5b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:47.409688 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-488929ad-6f42-4b61-bf13-4e0e2e2e5b5b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:47.499430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:23:47.499933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:23:47.500413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:23:47.500826 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:23:47.501238 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:23:47.510096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:47.510552 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:47.511381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:47.511818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:47.530215 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:23:47.534313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:23:47.545849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:23:47.548337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:23:47.575415 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-488929ad-6f42-4b61-bf13-4e0e2e2e5b5b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:47.584169 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-488929ad-6f42-4b61-bf13-4e0e2e2e5b5b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.187842 Apr 12 16:23:47.584748 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 383/769] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:47 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:47.597193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-38bff968-08e1-4145-aad0-18e81a838261 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689750 Apr 12 16:23:47.597827 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 387/770] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:23:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:23:47.607948 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-dee77c41-229b-4999-8fc4-e6aebde8b2e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:47.608729 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-dee77c41-229b-4999-8fc4-e6aebde8b2e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:47.665934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dee77c41-229b-4999-8fc4-e6aebde8b2e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:47.672566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-dee77c41-229b-4999-8fc4-e6aebde8b2e1 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1242 microversion: 2.1 time: 0.068438 Apr 12 16:23:47.673130 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 384/771] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:47 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:48.607207 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-21d89daa-a5a3-4263-aed2-f286535e11e7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:48.608204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-21d89daa-a5a3-4263-aed2-f286535e11e7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:48.619210 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-21d89daa-a5a3-4263-aed2-f286535e11e7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:48.619960 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-21d89daa-a5a3-4263-aed2-f286535e11e7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:48.621200 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-21d89daa-a5a3-4263-aed2-f286535e11e7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:48.621928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-21d89daa-a5a3-4263-aed2-f286535e11e7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:48.689168 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-fb23c4b8-07c0-4c76-9286-3c49638d00fd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:48.689731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-fb23c4b8-07c0-4c76-9286-3c49638d00fd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:48.696470 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fb23c4b8-07c0-4c76-9286-3c49638d00fd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:48.696886 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fb23c4b8-07c0-4c76-9286-3c49638d00fd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:48.697687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fb23c4b8-07c0-4c76-9286-3c49638d00fd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:48.698149 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fb23c4b8-07c0-4c76-9286-3c49638d00fd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:48.770890 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-fb23c4b8-07c0-4c76-9286-3c49638d00fd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:48.778736 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-fb23c4b8-07c0-4c76-9286-3c49638d00fd tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1246 microversion: 2.1 time: 0.093591 Apr 12 16:23:48.779306 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 385/772] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:48 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:48.793932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-21d89daa-a5a3-4263-aed2-f286535e11e7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:48.802220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-21d89daa-a5a3-4263-aed2-f286535e11e7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.202452 Apr 12 16:23:48.802761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 388/773] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:48 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:49.796274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-94e2ef5e-6cea-4796-9d74-5b9d49ca15a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:49.797091 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-94e2ef5e-6cea-4796-9d74-5b9d49ca15a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:49.803686 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-94e2ef5e-6cea-4796-9d74-5b9d49ca15a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:49.804137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-94e2ef5e-6cea-4796-9d74-5b9d49ca15a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:49.804910 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-94e2ef5e-6cea-4796-9d74-5b9d49ca15a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:49.805343 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-94e2ef5e-6cea-4796-9d74-5b9d49ca15a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:49.824799 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9b2e8e6c-0233-4dd5-87df-fabf854cbaf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:49.825510 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9b2e8e6c-0233-4dd5-87df-fabf854cbaf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:49.832256 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9b2e8e6c-0233-4dd5-87df-fabf854cbaf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:49.832712 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9b2e8e6c-0233-4dd5-87df-fabf854cbaf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:49.833491 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9b2e8e6c-0233-4dd5-87df-fabf854cbaf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:49.833928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9b2e8e6c-0233-4dd5-87df-fabf854cbaf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:49.878687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-94e2ef5e-6cea-4796-9d74-5b9d49ca15a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:49.886286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-94e2ef5e-6cea-4796-9d74-5b9d49ca15a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1246 microversion: 2.1 time: 0.093970 Apr 12 16:23:49.886864 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 386/774] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:49 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:49.969910 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9b2e8e6c-0233-4dd5-87df-fabf854cbaf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:49.978066 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9b2e8e6c-0233-4dd5-87df-fabf854cbaf5 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.157003 Apr 12 16:23:49.978645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 389/775] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:49 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:50.811846 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:23:50.812480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: Tue Apr 12 16:23:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:23:50.908431 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2dd3a9c8-5dfd-4e83-a453-950683f3da34 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:50.909500 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2dd3a9c8-5dfd-4e83-a453-950683f3da34 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:50.932605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2dd3a9c8-5dfd-4e83-a453-950683f3da34 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:50.933353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2dd3a9c8-5dfd-4e83-a453-950683f3da34 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:50.942372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2dd3a9c8-5dfd-4e83-a453-950683f3da34 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:50.942372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2dd3a9c8-5dfd-4e83-a453-950683f3da34 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:51.000547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d8edeb3d-34f3-49e3-b256-25870d818683 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:51.002659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d8edeb3d-34f3-49e3-b256-25870d818683 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:51.017598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d8edeb3d-34f3-49e3-b256-25870d818683 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:51.018672 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d8edeb3d-34f3-49e3-b256-25870d818683 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:51.020359 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d8edeb3d-34f3-49e3-b256-25870d818683 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:51.021366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d8edeb3d-34f3-49e3-b256-25870d818683 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:51.322010 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2dd3a9c8-5dfd-4e83-a453-950683f3da34 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:51.332037 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2dd3a9c8-5dfd-4e83-a453-950683f3da34 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1302 microversion: 2.1 time: 0.431470 Apr 12 16:23:51.332805 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 387/776] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:50 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1302 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:51.452410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d8edeb3d-34f3-49e3-b256-25870d818683 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:51.461170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d8edeb3d-34f3-49e3-b256-25870d818683 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.468509 Apr 12 16:23:51.461778 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 390/777] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:50 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:52.349283 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6e931276-8ac0-45c4-aea3-8a5e0a78b805 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:52.350169 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6e931276-8ac0-45c4-aea3-8a5e0a78b805 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:52.356354 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6e931276-8ac0-45c4-aea3-8a5e0a78b805 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:52.356877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6e931276-8ac0-45c4-aea3-8a5e0a78b805 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:52.357720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6e931276-8ac0-45c4-aea3-8a5e0a78b805 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:52.358253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6e931276-8ac0-45c4-aea3-8a5e0a78b805 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:52.487338 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-19c4224e-e84d-491a-8d17-7642c0c187c8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:52.488693 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-19c4224e-e84d-491a-8d17-7642c0c187c8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:52.499702 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-19c4224e-e84d-491a-8d17-7642c0c187c8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:52.500608 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-19c4224e-e84d-491a-8d17-7642c0c187c8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:52.501677 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-19c4224e-e84d-491a-8d17-7642c0c187c8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:52.502493 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-19c4224e-e84d-491a-8d17-7642c0c187c8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:52.589850 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6e931276-8ac0-45c4-aea3-8a5e0a78b805 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:52.599299 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6e931276-8ac0-45c4-aea3-8a5e0a78b805 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.253883 Apr 12 16:23:52.599890 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 388/778] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:52 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:52.736743 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-19c4224e-e84d-491a-8d17-7642c0c187c8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:52.754063 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-19c4224e-e84d-491a-8d17-7642c0c187c8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.273085 Apr 12 16:23:52.755258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 391/779] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:52 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:52.941448 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-cc8cf718-635c-4ffa-ab65-6ac6260a9fc6 req-cacaa4b6-793b-4de7-9d32-fb299c012ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea521f02-9af9-4bc5-b265-df2e2c2c70f5", "tag": "1812f159-e716-45a8-ad5e-89979163b257"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:52.951203 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-cc8cf718-635c-4ffa-ab65-6ac6260a9fc6 req-cacaa4b6-793b-4de7-9d32-fb299c012ac5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:52.952001 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-cc8cf718-635c-4ffa-ab65-6ac6260a9fc6 req-cacaa4b6-793b-4de7-9d32-fb299c012ac5 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:52.966767 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-cc8cf718-635c-4ffa-ab65-6ac6260a9fc6 req-cacaa4b6-793b-4de7-9d32-fb299c012ac5 service nova] Creating event network-changed:1812f159-e716-45a8-ad5e-89979163b257 for instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 on hv-cinder-83752 Apr 12 16:23:52.974546 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-cc8cf718-635c-4ffa-ab65-6ac6260a9fc6 req-cacaa4b6-793b-4de7-9d32-fb299c012ac5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037473 Apr 12 16:23:52.975892 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 389/780] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:23:53.617676 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d97bf7f4-c67b-4fa3-bf0d-fdda0fd48327 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:53.618758 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d97bf7f4-c67b-4fa3-bf0d-fdda0fd48327 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:53.626066 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d97bf7f4-c67b-4fa3-bf0d-fdda0fd48327 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:53.626590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d97bf7f4-c67b-4fa3-bf0d-fdda0fd48327 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:53.627390 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d97bf7f4-c67b-4fa3-bf0d-fdda0fd48327 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:53.627831 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d97bf7f4-c67b-4fa3-bf0d-fdda0fd48327 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:53.770836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d97bf7f4-c67b-4fa3-bf0d-fdda0fd48327 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:53.774105 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8cae0239-b505-4aeb-8746-6a358363fef7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:53.774885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8cae0239-b505-4aeb-8746-6a358363fef7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:53.778864 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d97bf7f4-c67b-4fa3-bf0d-fdda0fd48327 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.165714 Apr 12 16:23:53.779441 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 392/781] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:53 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:53.781318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8cae0239-b505-4aeb-8746-6a358363fef7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:53.782005 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8cae0239-b505-4aeb-8746-6a358363fef7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:53.782901 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8cae0239-b505-4aeb-8746-6a358363fef7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:53.783403 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8cae0239-b505-4aeb-8746-6a358363fef7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:53.923554 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8cae0239-b505-4aeb-8746-6a358363fef7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:53.931639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8cae0239-b505-4aeb-8746-6a358363fef7 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.162277 Apr 12 16:23:53.932209 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 390/782] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:53 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:23:54.798526 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d9a81fe9-8f7e-49c7-b75a-29e93625f65a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:54.799329 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d9a81fe9-8f7e-49c7-b75a-29e93625f65a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:54.806736 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9a81fe9-8f7e-49c7-b75a-29e93625f65a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:54.807188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9a81fe9-8f7e-49c7-b75a-29e93625f65a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:54.807959 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9a81fe9-8f7e-49c7-b75a-29e93625f65a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:54.808395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d9a81fe9-8f7e-49c7-b75a-29e93625f65a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:54.939023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d9a81fe9-8f7e-49c7-b75a-29e93625f65a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:54.946798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d9a81fe9-8f7e-49c7-b75a-29e93625f65a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.153769 Apr 12 16:23:54.947364 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 393/783] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:54 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:54.949333 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-561cb116-5f47-4410-90c8-2f8d9c3fedea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:54.949947 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-561cb116-5f47-4410-90c8-2f8d9c3fedea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:54.958025 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-561cb116-5f47-4410-90c8-2f8d9c3fedea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:54.958517 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-561cb116-5f47-4410-90c8-2f8d9c3fedea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:54.959303 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-561cb116-5f47-4410-90c8-2f8d9c3fedea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:54.959738 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-561cb116-5f47-4410-90c8-2f8d9c3fedea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:55.097473 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-561cb116-5f47-4410-90c8-2f8d9c3fedea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:55.110011 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-561cb116-5f47-4410-90c8-2f8d9c3fedea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.164221 Apr 12 16:23:55.111537 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 391/784] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:54 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:55.964833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-87934afe-f60e-4421-a1d8-f83fc0e3e4ec tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:55.965562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-87934afe-f60e-4421-a1d8-f83fc0e3e4ec tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:55.972820 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-87934afe-f60e-4421-a1d8-f83fc0e3e4ec tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:55.973283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-87934afe-f60e-4421-a1d8-f83fc0e3e4ec tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:55.974097 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-87934afe-f60e-4421-a1d8-f83fc0e3e4ec tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:55.974544 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-87934afe-f60e-4421-a1d8-f83fc0e3e4ec tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:56.103525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-87934afe-f60e-4421-a1d8-f83fc0e3e4ec tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:56.111644 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-87934afe-f60e-4421-a1d8-f83fc0e3e4ec tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.150733 Apr 12 16:23:56.112218 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 394/785] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:55 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:56.128116 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-479d4dd5-1ee3-495c-9579-51b447f35375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:56.128838 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-479d4dd5-1ee3-495c-9579-51b447f35375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:56.135695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-479d4dd5-1ee3-495c-9579-51b447f35375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:56.136154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-479d4dd5-1ee3-495c-9579-51b447f35375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:56.136931 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-479d4dd5-1ee3-495c-9579-51b447f35375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:56.137371 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-479d4dd5-1ee3-495c-9579-51b447f35375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:56.280434 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-479d4dd5-1ee3-495c-9579-51b447f35375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:56.288558 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-479d4dd5-1ee3-495c-9579-51b447f35375 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.164718 Apr 12 16:23:56.289132 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 392/786] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:56 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:57.129201 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7cad792e-d19d-4ad7-b761-240ba600dce9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:57.129874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7cad792e-d19d-4ad7-b761-240ba600dce9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:57.136362 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7cad792e-d19d-4ad7-b761-240ba600dce9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:57.136805 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7cad792e-d19d-4ad7-b761-240ba600dce9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:57.137581 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7cad792e-d19d-4ad7-b761-240ba600dce9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:57.138019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7cad792e-d19d-4ad7-b761-240ba600dce9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:57.278206 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7cad792e-d19d-4ad7-b761-240ba600dce9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:57.286379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7cad792e-d19d-4ad7-b761-240ba600dce9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.161172 Apr 12 16:23:57.286962 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 395/787] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:57 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:57.306295 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6ab9b82d-5cad-4435-ae1c-516077d5e0f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:57.306924 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6ab9b82d-5cad-4435-ae1c-516077d5e0f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:57.313676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6ab9b82d-5cad-4435-ae1c-516077d5e0f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:57.314171 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6ab9b82d-5cad-4435-ae1c-516077d5e0f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:57.314967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6ab9b82d-5cad-4435-ae1c-516077d5e0f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:57.315406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6ab9b82d-5cad-4435-ae1c-516077d5e0f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:57.451193 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6ab9b82d-5cad-4435-ae1c-516077d5e0f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:57.459579 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6ab9b82d-5cad-4435-ae1c-516077d5e0f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.157148 Apr 12 16:23:57.460161 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 393/788] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:57 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:58.307571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3a05b8c5-1127-40b8-934e-1ee708ad45da tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:58.308172 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3a05b8c5-1127-40b8-934e-1ee708ad45da tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:58.318014 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3a05b8c5-1127-40b8-934e-1ee708ad45da tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:58.318495 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3a05b8c5-1127-40b8-934e-1ee708ad45da tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:58.319800 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3a05b8c5-1127-40b8-934e-1ee708ad45da tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:58.320596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3a05b8c5-1127-40b8-934e-1ee708ad45da tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:58.459652 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3a05b8c5-1127-40b8-934e-1ee708ad45da tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:58.467785 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3a05b8c5-1127-40b8-934e-1ee708ad45da tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.168127 Apr 12 16:23:58.468339 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 396/789] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:58 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:58.482237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-86bc8381-c28c-4a07-b952-62e0cef633b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:58.483337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-86bc8381-c28c-4a07-b952-62e0cef633b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:58.491231 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-86bc8381-c28c-4a07-b952-62e0cef633b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:58.491664 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-86bc8381-c28c-4a07-b952-62e0cef633b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:58.492457 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-86bc8381-c28c-4a07-b952-62e0cef633b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:58.492887 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-86bc8381-c28c-4a07-b952-62e0cef633b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:58.627747 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-86bc8381-c28c-4a07-b952-62e0cef633b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:58.635896 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-86bc8381-c28c-4a07-b952-62e0cef633b8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1676 microversion: 2.1 time: 0.161214 Apr 12 16:23:58.636517 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 394/790] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:58 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:59.391839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-521b4d42-69c6-4267-a067-4f90b5fbc72f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c871263-1ea2-49f7-836f-b517510ed74f"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:59.393048 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-521b4d42-69c6-4267-a067-4f90b5fbc72f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:59.399701 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-521b4d42-69c6-4267-a067-4f90b5fbc72f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:59.400155 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-521b4d42-69c6-4267-a067-4f90b5fbc72f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:59.400942 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-521b4d42-69c6-4267-a067-4f90b5fbc72f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:59.401360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-521b4d42-69c6-4267-a067-4f90b5fbc72f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:59.491281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e0db9730-e77b-40d5-a2d9-0cd6018e359d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:59.492050 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e0db9730-e77b-40d5-a2d9-0cd6018e359d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:59.498787 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e0db9730-e77b-40d5-a2d9-0cd6018e359d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:59.499313 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e0db9730-e77b-40d5-a2d9-0cd6018e359d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:59.500108 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e0db9730-e77b-40d5-a2d9-0cd6018e359d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:59.500547 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e0db9730-e77b-40d5-a2d9-0cd6018e359d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:59.646062 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e0db9730-e77b-40d5-a2d9-0cd6018e359d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:59.655107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e0db9730-e77b-40d5-a2d9-0cd6018e359d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.167656 Apr 12 16:23:59.655770 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 395/791] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:59 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:59.679833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-521b4d42-69c6-4267-a067-4f90b5fbc72f tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411765 Apr 12 16:23:59.680573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 397/792] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:23:59 2022] POST /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:59.792089 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-676aadd5-a45a-4a63-98c6-39a9eecfd6ce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:59.792727 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-676aadd5-a45a-4a63-98c6-39a9eecfd6ce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:23:59.798940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-676aadd5-a45a-4a63-98c6-39a9eecfd6ce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:59.799392 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-676aadd5-a45a-4a63-98c6-39a9eecfd6ce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:59.800166 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-676aadd5-a45a-4a63-98c6-39a9eecfd6ce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:59.800606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-676aadd5-a45a-4a63-98c6-39a9eecfd6ce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:59.940515 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-676aadd5-a45a-4a63-98c6-39a9eecfd6ce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:23:59.948132 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-676aadd5-a45a-4a63-98c6-39a9eecfd6ce tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1653 microversion: 2.1 time: 0.291384 Apr 12 16:23:59.948697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 396/793] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:23:59 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1653 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:59.967464 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-657ef957-01b2-40d4-956f-233417424cae tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:59.974166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-657ef957-01b2-40d4-956f-233417424cae tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:23:59.974629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-657ef957-01b2-40d4-956f-233417424cae tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:23:59.998964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-657ef957-01b2-40d4-956f-233417424cae tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Going to try to start instance {{(pid=117202) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 12 16:24:00.046737 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-657ef957-01b2-40d4-956f-233417424cae tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/action" status: 202 len: 0 microversion: 2.1 time: 0.083223 Apr 12 16:24:00.047730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 398/794] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:23:59 2022] POST /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:24:00.060842 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8ad36f9e-15a8-4120-8a76-602ec50c1b82 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:00.062763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8ad36f9e-15a8-4120-8a76-602ec50c1b82 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:00.074552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8ad36f9e-15a8-4120-8a76-602ec50c1b82 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:00.075398 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8ad36f9e-15a8-4120-8a76-602ec50c1b82 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:00.077019 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8ad36f9e-15a8-4120-8a76-602ec50c1b82 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:00.077886 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8ad36f9e-15a8-4120-8a76-602ec50c1b82 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:00.373918 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8ad36f9e-15a8-4120-8a76-602ec50c1b82 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:00.387571 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8ad36f9e-15a8-4120-8a76-602ec50c1b82 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1662 microversion: 2.1 time: 0.334413 Apr 12 16:24:00.389239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 397/795] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:00 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1662 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:00.676809 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f650050e-d440-4a33-b2d7-c778a40f3341 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:00.677983 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f650050e-d440-4a33-b2d7-c778a40f3341 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:00.687961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f650050e-d440-4a33-b2d7-c778a40f3341 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:00.688619 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f650050e-d440-4a33-b2d7-c778a40f3341 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:00.689724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f650050e-d440-4a33-b2d7-c778a40f3341 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:00.690454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f650050e-d440-4a33-b2d7-c778a40f3341 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:00.816206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-d3bcd853-f86c-4991-b908-17cac2fa6d79 req-52041db7-9ac4-4a8d-b257-6a14e7469cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea521f02-9af9-4bc5-b265-df2e2c2c70f5", "name": "network-vif-plugged", "status": "completed", "tag": "1812f159-e716-45a8-ad5e-89979163b257"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:00.828523 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-d3bcd853-f86c-4991-b908-17cac2fa6d79 req-52041db7-9ac4-4a8d-b257-6a14e7469cf4 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:00.829404 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-d3bcd853-f86c-4991-b908-17cac2fa6d79 req-52041db7-9ac4-4a8d-b257-6a14e7469cf4 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:00.844846 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-d3bcd853-f86c-4991-b908-17cac2fa6d79 req-52041db7-9ac4-4a8d-b257-6a14e7469cf4 service nova] Creating event network-vif-plugged:1812f159-e716-45a8-ad5e-89979163b257 for instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 on hv-cinder-83752 Apr 12 16:24:00.857158 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-d3bcd853-f86c-4991-b908-17cac2fa6d79 req-52041db7-9ac4-4a8d-b257-6a14e7469cf4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046907 Apr 12 16:24:00.858304 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 398/796] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:24:00.966633 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f650050e-d440-4a33-b2d7-c778a40f3341 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:00.975847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f650050e-d440-4a33-b2d7-c778a40f3341 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.305520 Apr 12 16:24:00.976422 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 399/797] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:00 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:01.407839 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ee3b11fd-1d00-4796-9ea6-9809e460489a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:01.408572 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ee3b11fd-1d00-4796-9ea6-9809e460489a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:01.415269 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ee3b11fd-1d00-4796-9ea6-9809e460489a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:01.415725 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ee3b11fd-1d00-4796-9ea6-9809e460489a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:01.416486 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ee3b11fd-1d00-4796-9ea6-9809e460489a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:01.416931 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ee3b11fd-1d00-4796-9ea6-9809e460489a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:01.558292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ee3b11fd-1d00-4796-9ea6-9809e460489a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:01.566301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ee3b11fd-1d00-4796-9ea6-9809e460489a tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1662 microversion: 2.1 time: 0.162948 Apr 12 16:24:01.566744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 399/798] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:01 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:01.995157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ca43e743-9170-47e9-a755-099e0f81350c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:01.996565 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ca43e743-9170-47e9-a755-099e0f81350c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:02.004617 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ca43e743-9170-47e9-a755-099e0f81350c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:02.005134 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ca43e743-9170-47e9-a755-099e0f81350c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:02.006030 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ca43e743-9170-47e9-a755-099e0f81350c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:02.006539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ca43e743-9170-47e9-a755-099e0f81350c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:02.152088 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ca43e743-9170-47e9-a755-099e0f81350c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:02.160077 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ca43e743-9170-47e9-a755-099e0f81350c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.169413 Apr 12 16:24:02.160654 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 400/799] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:01 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:02.585360 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-96d0590a-01d8-4815-8ebf-d3877ff8e719 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:02.586200 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-96d0590a-01d8-4815-8ebf-d3877ff8e719 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:02.592442 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-96d0590a-01d8-4815-8ebf-d3877ff8e719 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:02.593134 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-96d0590a-01d8-4815-8ebf-d3877ff8e719 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:02.593796 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-96d0590a-01d8-4815-8ebf-d3877ff8e719 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:02.594258 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-96d0590a-01d8-4815-8ebf-d3877ff8e719 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:02.739300 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-96d0590a-01d8-4815-8ebf-d3877ff8e719 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:02.747314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-96d0590a-01d8-4815-8ebf-d3877ff8e719 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1666 microversion: 2.1 time: 0.165828 Apr 12 16:24:02.747877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 400/800] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:02 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:03.178832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8ca0d84c-c1a5-4ea0-b652-6fe8334b48c7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:03.179436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8ca0d84c-c1a5-4ea0-b652-6fe8334b48c7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:03.186187 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8ca0d84c-c1a5-4ea0-b652-6fe8334b48c7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:03.186696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8ca0d84c-c1a5-4ea0-b652-6fe8334b48c7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:03.187501 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8ca0d84c-c1a5-4ea0-b652-6fe8334b48c7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:03.187932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8ca0d84c-c1a5-4ea0-b652-6fe8334b48c7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:03.318953 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8ca0d84c-c1a5-4ea0-b652-6fe8334b48c7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:03.326517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8ca0d84c-c1a5-4ea0-b652-6fe8334b48c7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1367 microversion: 2.1 time: 0.152727 Apr 12 16:24:03.327111 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 401/801] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:03 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:04.344857 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2ae16340-752b-43ea-b6c9-b49f40e53f86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:04.345443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2ae16340-752b-43ea-b6c9-b49f40e53f86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:04.351697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2ae16340-752b-43ea-b6c9-b49f40e53f86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:04.352146 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2ae16340-752b-43ea-b6c9-b49f40e53f86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:04.352912 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2ae16340-752b-43ea-b6c9-b49f40e53f86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:04.353342 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2ae16340-752b-43ea-b6c9-b49f40e53f86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:04.504807 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2ae16340-752b-43ea-b6c9-b49f40e53f86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:04.515718 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2ae16340-752b-43ea-b6c9-b49f40e53f86 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1557 microversion: 2.1 time: 0.175100 Apr 12 16:24:04.516298 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 401/802] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:04 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:04.535154 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d26b9dea-fdd1-4958-8558-86e665704ea4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:04.535697 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d26b9dea-fdd1-4958-8558-86e665704ea4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:04.542470 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d26b9dea-fdd1-4958-8558-86e665704ea4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:04.542919 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d26b9dea-fdd1-4958-8558-86e665704ea4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:04.543689 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d26b9dea-fdd1-4958-8558-86e665704ea4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:04.544118 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d26b9dea-fdd1-4958-8558-86e665704ea4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:04.627203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d26b9dea-fdd1-4958-8558-86e665704ea4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095713 Apr 12 16:24:04.628115 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 402/803] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Apr 12 16:24:04 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:05.693449 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-5ffe496e-fb7b-4aa6-bffd-57fa68f14225 req-d739492a-49de-4c09-8859-2f90b5d95137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea521f02-9af9-4bc5-b265-df2e2c2c70f5", "tag": "1812f159-e716-45a8-ad5e-89979163b257"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:05.701536 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-5ffe496e-fb7b-4aa6-bffd-57fa68f14225 req-d739492a-49de-4c09-8859-2f90b5d95137 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:05.702214 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-5ffe496e-fb7b-4aa6-bffd-57fa68f14225 req-d739492a-49de-4c09-8859-2f90b5d95137 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:05.714073 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-5ffe496e-fb7b-4aa6-bffd-57fa68f14225 req-d739492a-49de-4c09-8859-2f90b5d95137 service nova] Creating event network-changed:1812f159-e716-45a8-ad5e-89979163b257 for instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 on hv-cinder-83752 Apr 12 16:24:05.719566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-5ffe496e-fb7b-4aa6-bffd-57fa68f14225 req-d739492a-49de-4c09-8859-2f90b5d95137 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084184 Apr 12 16:24:05.720118 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 402/804] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:24:07.259939 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-07ae5d65-f925-42fe-931c-e31f0d6da856 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:07.261070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-07ae5d65-f925-42fe-931c-e31f0d6da856 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:07.268019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07ae5d65-f925-42fe-931c-e31f0d6da856 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:07.268710 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07ae5d65-f925-42fe-931c-e31f0d6da856 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:07.269670 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07ae5d65-f925-42fe-931c-e31f0d6da856 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:07.270136 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07ae5d65-f925-42fe-931c-e31f0d6da856 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:07.294448 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-07ae5d65-f925-42fe-931c-e31f0d6da856 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lazy-loading 'flavor' on Instance uuid b37fad20-9d1f-4785-ac0d-9babf6466375 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:24:07.426522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-07ae5d65-f925-42fe-931c-e31f0d6da856 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/action" status: 200 len: 32 microversion: 2.1 time: 0.170941 Apr 12 16:24:07.427139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 403/805] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:24:07 2022] POST /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:24:07.454196 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d2138345-90ae-4492-8be0-50ed76d622e3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:07.455184 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d2138345-90ae-4492-8be0-50ed76d622e3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:07.463305 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d2138345-90ae-4492-8be0-50ed76d622e3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:07.463761 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d2138345-90ae-4492-8be0-50ed76d622e3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:07.464539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d2138345-90ae-4492-8be0-50ed76d622e3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:07.464975 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d2138345-90ae-4492-8be0-50ed76d622e3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:07.697216 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d2138345-90ae-4492-8be0-50ed76d622e3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:07.712625 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d2138345-90ae-4492-8be0-50ed76d622e3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.273827 Apr 12 16:24:07.713688 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 403/806] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:07 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:08.732303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e8d6dfa7-bf06-449c-8fd8-11ff71a7fa02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:08.733109 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e8d6dfa7-bf06-449c-8fd8-11ff71a7fa02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:08.739431 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e8d6dfa7-bf06-449c-8fd8-11ff71a7fa02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:08.739875 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e8d6dfa7-bf06-449c-8fd8-11ff71a7fa02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:08.740656 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e8d6dfa7-bf06-449c-8fd8-11ff71a7fa02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:08.741091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e8d6dfa7-bf06-449c-8fd8-11ff71a7fa02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:08.879481 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e8d6dfa7-bf06-449c-8fd8-11ff71a7fa02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:08.888012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e8d6dfa7-bf06-449c-8fd8-11ff71a7fa02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.160480 Apr 12 16:24:08.888614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 404/807] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:08 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:09.906281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-094fae5f-fa36-45b7-a40d-e467a8521e39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:09.907007 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-094fae5f-fa36-45b7-a40d-e467a8521e39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:09.913628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-094fae5f-fa36-45b7-a40d-e467a8521e39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:09.914084 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-094fae5f-fa36-45b7-a40d-e467a8521e39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:09.914870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-094fae5f-fa36-45b7-a40d-e467a8521e39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:09.915308 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-094fae5f-fa36-45b7-a40d-e467a8521e39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:10.068384 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-094fae5f-fa36-45b7-a40d-e467a8521e39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:10.077135 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-094fae5f-fa36-45b7-a40d-e467a8521e39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.174788 Apr 12 16:24:10.077903 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 404/808] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:09 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:11.095766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c0ace77d-a3b9-4524-8a34-16df8c7d09c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:11.096385 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c0ace77d-a3b9-4524-8a34-16df8c7d09c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:11.102944 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c0ace77d-a3b9-4524-8a34-16df8c7d09c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:11.103389 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c0ace77d-a3b9-4524-8a34-16df8c7d09c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:11.104180 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c0ace77d-a3b9-4524-8a34-16df8c7d09c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:11.104642 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c0ace77d-a3b9-4524-8a34-16df8c7d09c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:11.241092 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c0ace77d-a3b9-4524-8a34-16df8c7d09c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:11.250123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c0ace77d-a3b9-4524-8a34-16df8c7d09c8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.158705 Apr 12 16:24:11.250716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 405/809] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:11 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:12.268688 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-47dbeb71-6cac-410a-9718-c9382a8a093a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:12.269285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-47dbeb71-6cac-410a-9718-c9382a8a093a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:12.275827 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47dbeb71-6cac-410a-9718-c9382a8a093a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:12.276275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47dbeb71-6cac-410a-9718-c9382a8a093a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:12.277067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47dbeb71-6cac-410a-9718-c9382a8a093a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:12.277499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47dbeb71-6cac-410a-9718-c9382a8a093a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:12.437315 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-47dbeb71-6cac-410a-9718-c9382a8a093a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:12.447241 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-47dbeb71-6cac-410a-9718-c9382a8a093a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.183218 Apr 12 16:24:12.447832 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 405/810] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:12 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:13.465148 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2bb93ae9-285c-48cb-91ec-a2812cc81779 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:13.465720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2bb93ae9-285c-48cb-91ec-a2812cc81779 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:13.474273 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2bb93ae9-285c-48cb-91ec-a2812cc81779 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:13.474719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2bb93ae9-285c-48cb-91ec-a2812cc81779 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:13.475837 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2bb93ae9-285c-48cb-91ec-a2812cc81779 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:13.476521 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2bb93ae9-285c-48cb-91ec-a2812cc81779 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:13.613523 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2bb93ae9-285c-48cb-91ec-a2812cc81779 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:13.621903 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2bb93ae9-285c-48cb-91ec-a2812cc81779 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.160802 Apr 12 16:24:13.622526 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 406/811] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:13 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:14.643127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-56b6fb18-402a-4c03-99e4-a60b9ffd8579 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:14.643928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-56b6fb18-402a-4c03-99e4-a60b9ffd8579 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:14.654019 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56b6fb18-402a-4c03-99e4-a60b9ffd8579 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:14.654669 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56b6fb18-402a-4c03-99e4-a60b9ffd8579 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:14.655588 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56b6fb18-402a-4c03-99e4-a60b9ffd8579 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:14.656031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56b6fb18-402a-4c03-99e4-a60b9ffd8579 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:14.798185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-56b6fb18-402a-4c03-99e4-a60b9ffd8579 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:14.806575 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-56b6fb18-402a-4c03-99e4-a60b9ffd8579 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.169937 Apr 12 16:24:14.807138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 406/812] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:14 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:15.827253 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-313d95a6-ed42-4cb7-9292-870407b6429d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:15.827961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-313d95a6-ed42-4cb7-9292-870407b6429d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:15.835150 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-313d95a6-ed42-4cb7-9292-870407b6429d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:15.835599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-313d95a6-ed42-4cb7-9292-870407b6429d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:15.836366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-313d95a6-ed42-4cb7-9292-870407b6429d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:15.836796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-313d95a6-ed42-4cb7-9292-870407b6429d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:15.968971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-313d95a6-ed42-4cb7-9292-870407b6429d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:15.977399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-313d95a6-ed42-4cb7-9292-870407b6429d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.155739 Apr 12 16:24:15.978014 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 407/813] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:15 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:16.998497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-12d580f3-1396-4aee-83d9-604a3e7f0538 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:16.999232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-12d580f3-1396-4aee-83d9-604a3e7f0538 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:17.005943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12d580f3-1396-4aee-83d9-604a3e7f0538 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:17.006501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12d580f3-1396-4aee-83d9-604a3e7f0538 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:17.007275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12d580f3-1396-4aee-83d9-604a3e7f0538 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:17.007712 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12d580f3-1396-4aee-83d9-604a3e7f0538 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:17.141780 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-12d580f3-1396-4aee-83d9-604a3e7f0538 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:17.154121 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-12d580f3-1396-4aee-83d9-604a3e7f0538 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.161408 Apr 12 16:24:17.155071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 407/814] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:16 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:18.172354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-380508a3-9466-4c73-8cb1-a108d3500a91 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18.172972 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-380508a3-9466-4c73-8cb1-a108d3500a91 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:18.179718 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-380508a3-9466-4c73-8cb1-a108d3500a91 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:18.180171 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-380508a3-9466-4c73-8cb1-a108d3500a91 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:18.180948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-380508a3-9466-4c73-8cb1-a108d3500a91 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:18.181384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-380508a3-9466-4c73-8cb1-a108d3500a91 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:18.323639 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-380508a3-9466-4c73-8cb1-a108d3500a91 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:18.335964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-380508a3-9466-4c73-8cb1-a108d3500a91 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.167642 Apr 12 16:24:18.336827 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 408/815] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:18 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:19.358225 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ff645cfe-b422-4f86-ac91-0fe6b7acfc75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:19.359321 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ff645cfe-b422-4f86-ac91-0fe6b7acfc75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:19.370630 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff645cfe-b422-4f86-ac91-0fe6b7acfc75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:19.371337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff645cfe-b422-4f86-ac91-0fe6b7acfc75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:19.372621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff645cfe-b422-4f86-ac91-0fe6b7acfc75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:19.374223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ff645cfe-b422-4f86-ac91-0fe6b7acfc75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:19.522751 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ff645cfe-b422-4f86-ac91-0fe6b7acfc75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:19.537595 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ff645cfe-b422-4f86-ac91-0fe6b7acfc75 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.185019 Apr 12 16:24:19.539125 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 408/816] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:19 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:20.555872 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eca1b61a-0764-4dde-ad6b-f48cada870d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:20.556629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-eca1b61a-0764-4dde-ad6b-f48cada870d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:20.564433 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eca1b61a-0764-4dde-ad6b-f48cada870d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:20.564889 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eca1b61a-0764-4dde-ad6b-f48cada870d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:20.565766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eca1b61a-0764-4dde-ad6b-f48cada870d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:20.566304 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eca1b61a-0764-4dde-ad6b-f48cada870d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:20.709025 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-eca1b61a-0764-4dde-ad6b-f48cada870d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:20.718349 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-eca1b61a-0764-4dde-ad6b-f48cada870d5 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.166418 Apr 12 16:24:20.718984 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 409/817] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:20 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:21.738875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a88182c7-9626-4702-bb82-4c0be21cf260 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:21.739496 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a88182c7-9626-4702-bb82-4c0be21cf260 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:21.746671 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a88182c7-9626-4702-bb82-4c0be21cf260 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:21.747120 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a88182c7-9626-4702-bb82-4c0be21cf260 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:21.747890 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a88182c7-9626-4702-bb82-4c0be21cf260 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:21.748301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a88182c7-9626-4702-bb82-4c0be21cf260 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:21.893803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a88182c7-9626-4702-bb82-4c0be21cf260 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:21.906200 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a88182c7-9626-4702-bb82-4c0be21cf260 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.170775 Apr 12 16:24:21.907081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 409/818] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:21 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:22.125995 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eb12e09b-1465-45a1-92da-d514de58ec01 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-761886994"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:22.126590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-eb12e09b-1465-45a1-92da-d514de58ec01 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:22.133203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb12e09b-1465-45a1-92da-d514de58ec01 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:22.133649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb12e09b-1465-45a1-92da-d514de58ec01 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:22.134472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb12e09b-1465-45a1-92da-d514de58ec01 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:22.134907 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb12e09b-1465-45a1-92da-d514de58ec01 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:22.263615 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.network.security_group_api [None req-eb12e09b-1465-45a1-92da-d514de58ec01 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Removing security group 6a2986f5-b1de-47c0-ace0-c1573b2644a1 from port 94c5c57b-adf1-460f-930c-36fd03392889 Apr 12 16:24:22.630573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-eb12e09b-1465-45a1-92da-d514de58ec01 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "POST /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/action" status: 202 len: 0 microversion: 2.1 time: 0.508613 Apr 12 16:24:22.634539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 410/819] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:24:22 2022] POST /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:24:22.648287 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-daa27106-4baa-498e-a09c-7637a3b94b57 req-418b0b75-6ff1-460a-aea0-41798e2e1947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74711e3a-cd18-4260-b9d1-7f393f377971", "tag": "94c5c57b-adf1-460f-930c-36fd03392889"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:22.661141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-daa27106-4baa-498e-a09c-7637a3b94b57 req-418b0b75-6ff1-460a-aea0-41798e2e1947 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:22.661832 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-daa27106-4baa-498e-a09c-7637a3b94b57 req-418b0b75-6ff1-460a-aea0-41798e2e1947 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:22.683878 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-daa27106-4baa-498e-a09c-7637a3b94b57 req-418b0b75-6ff1-460a-aea0-41798e2e1947 service nova] Creating event network-changed:94c5c57b-adf1-460f-930c-36fd03392889 for instance 74711e3a-cd18-4260-b9d1-7f393f377971 on hv-cinder-83752 Apr 12 16:24:22.696453 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-daa27106-4baa-498e-a09c-7637a3b94b57 req-418b0b75-6ff1-460a-aea0-41798e2e1947 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048483 Apr 12 16:24:22.697658 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 410/820] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:22.925735 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e4ee519e-4ad5-47d5-9010-393cea2cfc15 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:22.927024 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e4ee519e-4ad5-47d5-9010-393cea2cfc15 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:22.933777 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e4ee519e-4ad5-47d5-9010-393cea2cfc15 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:22.934506 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e4ee519e-4ad5-47d5-9010-393cea2cfc15 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:22.935287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e4ee519e-4ad5-47d5-9010-393cea2cfc15 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:22.935849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e4ee519e-4ad5-47d5-9010-393cea2cfc15 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:23.201414 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e4ee519e-4ad5-47d5-9010-393cea2cfc15 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:23.210568 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e4ee519e-4ad5-47d5-9010-393cea2cfc15 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.289590 Apr 12 16:24:23.211152 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 411/821] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:22 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:24.228190 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d5a97ddd-7ece-4aa9-9c14-8f99620f35fd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:24.229556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d5a97ddd-7ece-4aa9-9c14-8f99620f35fd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:24.236632 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d5a97ddd-7ece-4aa9-9c14-8f99620f35fd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.237110 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d5a97ddd-7ece-4aa9-9c14-8f99620f35fd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.238720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d5a97ddd-7ece-4aa9-9c14-8f99620f35fd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.239361 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d5a97ddd-7ece-4aa9-9c14-8f99620f35fd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.446066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bdf825d7-d6c6-43ac-b156-bece8e89fdb0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:24.446693 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bdf825d7-d6c6-43ac-b156-bece8e89fdb0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:24.448810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d5a97ddd-7ece-4aa9-9c14-8f99620f35fd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:24.453880 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bdf825d7-d6c6-43ac-b156-bece8e89fdb0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.454548 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bdf825d7-d6c6-43ac-b156-bece8e89fdb0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.455586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bdf825d7-d6c6-43ac-b156-bece8e89fdb0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.456088 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bdf825d7-d6c6-43ac-b156-bece8e89fdb0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.457435 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d5a97ddd-7ece-4aa9-9c14-8f99620f35fd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.233252 Apr 12 16:24:24.458070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 412/822] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:24 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:24.472370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8abda3d7-b487-4425-9f96-125ba98452d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:24.472905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8abda3d7-b487-4425-9f96-125ba98452d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:24.479002 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8abda3d7-b487-4425-9f96-125ba98452d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.479456 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8abda3d7-b487-4425-9f96-125ba98452d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.480237 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8abda3d7-b487-4425-9f96-125ba98452d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.480682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8abda3d7-b487-4425-9f96-125ba98452d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.486446 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bdf825d7-d6c6-43ac-b156-bece8e89fdb0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments/060d8aec-57e3-4413-8f96-e837ca65d878" status: 200 len: 194 microversion: 2.20 time: 0.295680 Apr 12 16:24:24.487354 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 411/823] 10.222.0.67 () {60 vars in 1453 bytes} [Tue Apr 12 16:24:24 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments/060d8aec-57e3-4413-8f96-e837ca65d878 => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:24:24.553037 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-73eceb1e-8ed4-44d9-9eb8-034effd2fc88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:24.553688 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-73eceb1e-8ed4-44d9-9eb8-034effd2fc88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:24.559832 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73eceb1e-8ed4-44d9-9eb8-034effd2fc88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.560313 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73eceb1e-8ed4-44d9-9eb8-034effd2fc88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.561153 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73eceb1e-8ed4-44d9-9eb8-034effd2fc88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.561671 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73eceb1e-8ed4-44d9-9eb8-034effd2fc88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.563034 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-8abda3d7-b487-4425-9f96-125ba98452d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lazy-loading 'services' on Instance uuid 74711e3a-cd18-4260-b9d1-7f393f377971 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:24:24.641782 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8abda3d7-b487-4425-9f96-125ba98452d3 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "DELETE /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments/17d72b2a-32b6-4f11-916b-f548f6436140" status: 202 len: 0 microversion: 2.1 time: 0.173111 Apr 12 16:24:24.642850 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 413/824] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:24:24 2022] DELETE /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments/17d72b2a-32b6-4f11-916b-f548f6436140 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:24:24.650709 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-73eceb1e-8ed4-44d9-9eb8-034effd2fc88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lazy-loading 'services' on Instance uuid 29f48c36-5e37-4640-b589-df261265d809 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:24:24.661281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-146d94b6-7348-4779-b4c8-f7ee48f3db0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:24.662538 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-146d94b6-7348-4779-b4c8-f7ee48f3db0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:24.669801 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-146d94b6-7348-4779-b4c8-f7ee48f3db0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.670320 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-146d94b6-7348-4779-b4c8-f7ee48f3db0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.671671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-146d94b6-7348-4779-b4c8-f7ee48f3db0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.672497 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-146d94b6-7348-4779-b4c8-f7ee48f3db0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.709262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-146d94b6-7348-4779-b4c8-f7ee48f3db0b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061944 Apr 12 16:24:24.710070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 414/825] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:24:24 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:24.719890 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-c6c1a6c0-39b1-4273-bbb3-796a6d05f298 req-1180b4bf-ff08-47fe-8910-d1e1625f2034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74711e3a-cd18-4260-b9d1-7f393f377971", "tag": "94c5c57b-adf1-460f-930c-36fd03392889"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:24.728588 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-c6c1a6c0-39b1-4273-bbb3-796a6d05f298 req-1180b4bf-ff08-47fe-8910-d1e1625f2034 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.729035 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-c6c1a6c0-39b1-4273-bbb3-796a6d05f298 req-1180b4bf-ff08-47fe-8910-d1e1625f2034 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.736429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-73eceb1e-8ed4-44d9-9eb8-034effd2fc88 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "DELETE /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments/060d8aec-57e3-4413-8f96-e837ca65d878" status: 202 len: 0 microversion: 2.20 time: 0.187287 Apr 12 16:24:24.737683 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 412/826] 10.222.0.67 () {60 vars in 1456 bytes} [Tue Apr 12 16:24:24 2022] DELETE /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments/060d8aec-57e3-4413-8f96-e837ca65d878 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:24:24.742453 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-c6c1a6c0-39b1-4273-bbb3-796a6d05f298 req-1180b4bf-ff08-47fe-8910-d1e1625f2034 service nova] Creating event network-changed:94c5c57b-adf1-460f-930c-36fd03392889 for instance 74711e3a-cd18-4260-b9d1-7f393f377971 on hv-cinder-83752 Apr 12 16:24:24.747529 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-c6c1a6c0-39b1-4273-bbb3-796a6d05f298 req-1180b4bf-ff08-47fe-8910-d1e1625f2034 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031864 Apr 12 16:24:24.748254 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-53e042b4-de80-4cab-ad7d-c60d48bdd4a9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:24.748853 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 415/827] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:24.751016 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-53e042b4-de80-4cab-ad7d-c60d48bdd4a9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:24.762071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53e042b4-de80-4cab-ad7d-c60d48bdd4a9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.762512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53e042b4-de80-4cab-ad7d-c60d48bdd4a9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.763337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53e042b4-de80-4cab-ad7d-c60d48bdd4a9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:24.763911 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53e042b4-de80-4cab-ad7d-c60d48bdd4a9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:24.805995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-53e042b4-de80-4cab-ad7d-c60d48bdd4a9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063846 Apr 12 16:24:24.807665 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 413/828] 10.222.0.67 () {60 vars in 1342 bytes} [Tue Apr 12 16:24:24 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 16:24:25.476487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eaee802e-735b-4d50-9124-05579b0997b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:25.477107 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-eaee802e-735b-4d50-9124-05579b0997b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:25.486555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eaee802e-735b-4d50-9124-05579b0997b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:25.487014 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eaee802e-735b-4d50-9124-05579b0997b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:25.487818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eaee802e-735b-4d50-9124-05579b0997b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:25.488254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eaee802e-735b-4d50-9124-05579b0997b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:25.632207 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-eaee802e-735b-4d50-9124-05579b0997b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:25.641547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-eaee802e-735b-4d50-9124-05579b0997b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.169964 Apr 12 16:24:25.642138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 416/829] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:25 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:25.722280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d9b3f344-4e17-4a95-8474-353be5f412f4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:25.723206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d9b3f344-4e17-4a95-8474-353be5f412f4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:25.729960 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d9b3f344-4e17-4a95-8474-353be5f412f4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:25.730415 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d9b3f344-4e17-4a95-8474-353be5f412f4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:25.731223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d9b3f344-4e17-4a95-8474-353be5f412f4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:25.731663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d9b3f344-4e17-4a95-8474-353be5f412f4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:25.762099 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d9b3f344-4e17-4a95-8474-353be5f412f4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Apr 12 16:24:25.763051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 414/830] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:24:25 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:25.818337 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-badf1afc-4e86-43ae-ac60-c0977fbde010 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:25.819275 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-badf1afc-4e86-43ae-ac60-c0977fbde010 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:25.825298 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-badf1afc-4e86-43ae-ac60-c0977fbde010 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:25.825751 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-badf1afc-4e86-43ae-ac60-c0977fbde010 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:25.826782 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-badf1afc-4e86-43ae-ac60-c0977fbde010 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:25.827226 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-badf1afc-4e86-43ae-ac60-c0977fbde010 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:25.857198 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-badf1afc-4e86-43ae-ac60-c0977fbde010 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042875 Apr 12 16:24:25.857858 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 417/831] 10.222.0.67 () {60 vars in 1342 bytes} [Tue Apr 12 16:24:25 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:24:26.659441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8cfb30c8-89fd-48b2-bdac-7f32afad0b26 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:26.660082 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8cfb30c8-89fd-48b2-bdac-7f32afad0b26 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:26.671958 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8cfb30c8-89fd-48b2-bdac-7f32afad0b26 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:26.672423 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8cfb30c8-89fd-48b2-bdac-7f32afad0b26 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:26.673215 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8cfb30c8-89fd-48b2-bdac-7f32afad0b26 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:26.673648 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8cfb30c8-89fd-48b2-bdac-7f32afad0b26 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:26.774508 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-65d1a716-1660-42f3-85e5-a9ed1e2dce9f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:26.775961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-65d1a716-1660-42f3-85e5-a9ed1e2dce9f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:26.782762 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65d1a716-1660-42f3-85e5-a9ed1e2dce9f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:26.783216 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65d1a716-1660-42f3-85e5-a9ed1e2dce9f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:26.784001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65d1a716-1660-42f3-85e5-a9ed1e2dce9f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:26.784469 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65d1a716-1660-42f3-85e5-a9ed1e2dce9f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:26.815886 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-65d1a716-1660-42f3-85e5-a9ed1e2dce9f tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Apr 12 16:24:26.816451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 418/832] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:24:26 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:26.833461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8cfb30c8-89fd-48b2-bdac-7f32afad0b26 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:26.841878 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8cfb30c8-89fd-48b2-bdac-7f32afad0b26 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.186436 Apr 12 16:24:26.842477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 415/833] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:26 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:26.869021 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eb71384f-946b-44d1-9925-dcdc75e4f90d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:26.869937 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-eb71384f-946b-44d1-9925-dcdc75e4f90d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:26.876350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb71384f-946b-44d1-9925-dcdc75e4f90d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:26.876792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb71384f-946b-44d1-9925-dcdc75e4f90d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:26.877549 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb71384f-946b-44d1-9925-dcdc75e4f90d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:26.877976 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb71384f-946b-44d1-9925-dcdc75e4f90d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:26.907907 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-eb71384f-946b-44d1-9925-dcdc75e4f90d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042805 Apr 12 16:24:26.908460 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 419/834] 10.222.0.67 () {60 vars in 1342 bytes} [Tue Apr 12 16:24:26 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:24:27.827695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-80c4fde5-2bb8-406e-8db6-9d3da05efb4d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:27.828942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-80c4fde5-2bb8-406e-8db6-9d3da05efb4d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:27.835711 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-80c4fde5-2bb8-406e-8db6-9d3da05efb4d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:27.836318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-80c4fde5-2bb8-406e-8db6-9d3da05efb4d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:27.836930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-80c4fde5-2bb8-406e-8db6-9d3da05efb4d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:27.837370 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-80c4fde5-2bb8-406e-8db6-9d3da05efb4d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:27.860267 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dcd03139-b3a5-4ca8-bedc-a49a93d7ac58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:27.860776 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dcd03139-b3a5-4ca8-bedc-a49a93d7ac58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:27.867322 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dcd03139-b3a5-4ca8-bedc-a49a93d7ac58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:27.867504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-80c4fde5-2bb8-406e-8db6-9d3da05efb4d tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043956 Apr 12 16:24:27.867774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dcd03139-b3a5-4ca8-bedc-a49a93d7ac58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:27.868097 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 416/835] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:24:27 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:24:27.868551 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dcd03139-b3a5-4ca8-bedc-a49a93d7ac58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:27.869016 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dcd03139-b3a5-4ca8-bedc-a49a93d7ac58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:27.877849 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:27.878376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:27.884587 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:27.885043 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:27.885805 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:27.886288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:27.963961 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] HTTP exception thrown: Instance 74711e3a-cd18-4260-b9d1-7f393f377971 is not attached to volume 17d72b2a-32b6-4f11-916b-f548f6436140 Apr 12 16:24:27.964566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Returning 404 to user: Instance 74711e3a-cd18-4260-b9d1-7f393f377971 is not attached to volume 17d72b2a-32b6-4f11-916b-f548f6436140 {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:24:27.965427 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-630ad709-00db-4686-9c59-0d3731bb5d1c tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "DELETE /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments/17d72b2a-32b6-4f11-916b-f548f6436140" status: 404 len: 154 microversion: 2.1 time: 0.091422 Apr 12 16:24:27.965960 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 417/836] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:24:27 2022] DELETE /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971/os-volume_attachments/17d72b2a-32b6-4f11-916b-f548f6436140 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:27.970979 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3aa39e47-919a-42b0-87f4-7f72f8b18f5b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:27.971959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3aa39e47-919a-42b0-87f4-7f72f8b18f5b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:27.977900 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3aa39e47-919a-42b0-87f4-7f72f8b18f5b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:27.978591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3aa39e47-919a-42b0-87f4-7f72f8b18f5b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:27.979791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3aa39e47-919a-42b0-87f4-7f72f8b18f5b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:27.979791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3aa39e47-919a-42b0-87f4-7f72f8b18f5b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:28.011189 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3aa39e47-919a-42b0-87f4-7f72f8b18f5b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044117 Apr 12 16:24:28.011972 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 418/837] 10.222.0.67 () {60 vars in 1342 bytes} [Tue Apr 12 16:24:27 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:28.015131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dcd03139-b3a5-4ca8-bedc-a49a93d7ac58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:28.024715 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dcd03139-b3a5-4ca8-bedc-a49a93d7ac58 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.169206 Apr 12 16:24:28.025898 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 420/838] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:27 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:28.073273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-eb69c9f4-5e01-4104-b3d0-c8c7c4dcdbcd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:28.073965 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-eb69c9f4-5e01-4104-b3d0-c8c7c4dcdbcd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:28.081353 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb69c9f4-5e01-4104-b3d0-c8c7c4dcdbcd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:28.081923 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb69c9f4-5e01-4104-b3d0-c8c7c4dcdbcd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:28.082795 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb69c9f4-5e01-4104-b3d0-c8c7c4dcdbcd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:28.083304 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eb69c9f4-5e01-4104-b3d0-c8c7c4dcdbcd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:28.109299 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-eb69c9f4-5e01-4104-b3d0-c8c7c4dcdbcd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Going to try to terminate instance {{(pid=117201) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:24:28.189200 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-eb69c9f4-5e01-4104-b3d0-c8c7c4dcdbcd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "DELETE /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 204 len: 0 microversion: 2.20 time: 0.119962 Apr 12 16:24:28.194117 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 419/839] 10.222.0.67 () {60 vars in 1279 bytes} [Tue Apr 12 16:24:28 2022] DELETE /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:24:28.199648 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:28.200339 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:28.207060 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:28.207551 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:28.208344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:28.208784 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:28.351973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:28.361085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:28.362790 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:28.364847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-024b08df-d8f7-452f-bbb9-4a5cff98f52d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.169045 Apr 12 16:24:28.365857 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 421/840] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:28 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:29.048641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5b7cfad5-94f7-45c9-8575-3964ce22c077 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:29.049809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5b7cfad5-94f7-45c9-8575-3964ce22c077 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:29.060141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b7cfad5-94f7-45c9-8575-3964ce22c077 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:29.061216 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b7cfad5-94f7-45c9-8575-3964ce22c077 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:29.062023 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b7cfad5-94f7-45c9-8575-3964ce22c077 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:29.062492 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b7cfad5-94f7-45c9-8575-3964ce22c077 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:29.115808 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1824af46-cc96-49b4-af50-3b29d2ff66d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:29.116884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1824af46-cc96-49b4-af50-3b29d2ff66d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:29.124284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1824af46-cc96-49b4-af50-3b29d2ff66d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:29.124743 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1824af46-cc96-49b4-af50-3b29d2ff66d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:29.125535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1824af46-cc96-49b4-af50-3b29d2ff66d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:29.125976 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1824af46-cc96-49b4-af50-3b29d2ff66d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:29.150349 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1824af46-cc96-49b4-af50-3b29d2ff66d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:24:29.202640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5b7cfad5-94f7-45c9-8575-3964ce22c077 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:29.211186 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5b7cfad5-94f7-45c9-8575-3964ce22c077 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.170150 Apr 12 16:24:29.211770 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 420/841] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:29 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:29.230439 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1824af46-cc96-49b4-af50-3b29d2ff66d5 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "DELETE /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 204 len: 0 microversion: 2.1 time: 0.120178 Apr 12 16:24:29.231245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 422/842] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:24:29 2022] DELETE /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:24:29.240543 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-20cfd77d-9a19-456a-bcb4-24929010e759 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:29.241280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-20cfd77d-9a19-456a-bcb4-24929010e759 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:29.247907 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-20cfd77d-9a19-456a-bcb4-24929010e759 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:29.248355 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-20cfd77d-9a19-456a-bcb4-24929010e759 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:29.249118 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-20cfd77d-9a19-456a-bcb4-24929010e759 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:29.249547 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-20cfd77d-9a19-456a-bcb4-24929010e759 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:29.385300 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:29.386173 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:29.392895 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:29.393346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:29.394167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:29.394610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:29.397568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-20cfd77d-9a19-456a-bcb4-24929010e759 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:29.405537 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-20cfd77d-9a19-456a-bcb4-24929010e759 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1554 microversion: 2.1 time: 0.169280 Apr 12 16:24:29.406377 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 421/843] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:29 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:29.536757 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:29.545369 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:29.546884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:29.548057 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ed5bcd3f-d319-45cb-83d7-069b20a83043 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.167461 Apr 12 16:24:29.548622 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 423/844] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:29 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:30.229188 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a959ed0c-f270-4d6e-ac96-e82ed79cf3e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:30.229795 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a959ed0c-f270-4d6e-ac96-e82ed79cf3e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:30.239289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a959ed0c-f270-4d6e-ac96-e82ed79cf3e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.239754 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a959ed0c-f270-4d6e-ac96-e82ed79cf3e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.240793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a959ed0c-f270-4d6e-ac96-e82ed79cf3e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.241480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a959ed0c-f270-4d6e-ac96-e82ed79cf3e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.423506 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-81e68bff-8574-45f8-a9cb-c6d414daa0a7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:30.424181 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-81e68bff-8574-45f8-a9cb-c6d414daa0a7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:30.431025 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-81e68bff-8574-45f8-a9cb-c6d414daa0a7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.431477 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-81e68bff-8574-45f8-a9cb-c6d414daa0a7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.432253 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-81e68bff-8574-45f8-a9cb-c6d414daa0a7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.432678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-81e68bff-8574-45f8-a9cb-c6d414daa0a7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.440721 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a959ed0c-f270-4d6e-ac96-e82ed79cf3e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:30.449036 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a959ed0c-f270-4d6e-ac96-e82ed79cf3e0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.223768 Apr 12 16:24:30.449598 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 422/845] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:30 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:30.566771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:30.567553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:30.569072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-81e68bff-8574-45f8-a9cb-c6d414daa0a7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:30.574189 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.574647 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.575430 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.575862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.577530 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-81e68bff-8574-45f8-a9cb-c6d414daa0a7 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1554 microversion: 2.1 time: 0.158253 Apr 12 16:24:30.578423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 424/846] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:30 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:30.710625 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:30.723008 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:30.725014 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:30.726797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a3f2f7d9-8ff7-4792-8d89-faeaa09e7b6b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.163785 Apr 12 16:24:30.727436 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 423/847] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:30 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:30.847644 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-fcf643b0-999e-4af8-b88a-435f983c7c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:30.848234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-fcf643b0-999e-4af8-b88a-435f983c7c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:30.856942 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fcf643b0-999e-4af8-b88a-435f983c7c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.857510 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fcf643b0-999e-4af8-b88a-435f983c7c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.858559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fcf643b0-999e-4af8-b88a-435f983c7c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.859001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fcf643b0-999e-4af8-b88a-435f983c7c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.885144 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-fcf643b0-999e-4af8-b88a-435f983c7c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:24:30.967475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-fcf643b0-999e-4af8-b88a-435f983c7c25 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 204 len: 0 microversion: 2.1 time: 0.124916 Apr 12 16:24:30.967998 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 425/848] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:24:30 2022] DELETE /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:24:30.976143 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9dd6b48b-569e-4352-89e3-42e819186821 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:30.976751 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9dd6b48b-569e-4352-89e3-42e819186821 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:30.983107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9dd6b48b-569e-4352-89e3-42e819186821 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.983558 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9dd6b48b-569e-4352-89e3-42e819186821 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:30.984318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9dd6b48b-569e-4352-89e3-42e819186821 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:30.984747 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9dd6b48b-569e-4352-89e3-42e819186821 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:31.117249 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9dd6b48b-569e-4352-89e3-42e819186821 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:31.125283 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9dd6b48b-569e-4352-89e3-42e819186821 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1576 microversion: 2.1 time: 0.152979 Apr 12 16:24:31.125847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 424/849] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:30 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:31.467314 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1ad39b9b-f412-4ccd-be6b-a8dd92d40b1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:31.468012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1ad39b9b-f412-4ccd-be6b-a8dd92d40b1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:31.474853 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ad39b9b-f412-4ccd-be6b-a8dd92d40b1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:31.475302 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ad39b9b-f412-4ccd-be6b-a8dd92d40b1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:31.476068 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ad39b9b-f412-4ccd-be6b-a8dd92d40b1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:31.476506 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1ad39b9b-f412-4ccd-be6b-a8dd92d40b1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:31.595651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5329a8e1-7262-4964-9aea-4eefe1b7dc39 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:31.596256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5329a8e1-7262-4964-9aea-4eefe1b7dc39 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:31.602634 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5329a8e1-7262-4964-9aea-4eefe1b7dc39 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:31.603082 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5329a8e1-7262-4964-9aea-4eefe1b7dc39 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:31.603878 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5329a8e1-7262-4964-9aea-4eefe1b7dc39 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:31.604348 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5329a8e1-7262-4964-9aea-4eefe1b7dc39 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:31.606891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1ad39b9b-f412-4ccd-be6b-a8dd92d40b1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:31.615386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1ad39b9b-f412-4ccd-be6b-a8dd92d40b1e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.152595 Apr 12 16:24:31.615952 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 426/850] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:31 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:31.728919 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5329a8e1-7262-4964-9aea-4eefe1b7dc39 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:31.737641 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5329a8e1-7262-4964-9aea-4eefe1b7dc39 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1554 microversion: 2.1 time: 0.145956 Apr 12 16:24:31.738634 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 425/851] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:31 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:31.748436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:31.749284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:31.759618 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:31.760394 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:31.761750 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:31.762602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:31.897338 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:31.907293 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:31.908780 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:31.909951 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8967c0e3-e5d7-401a-bb66-310266f5316a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.166053 Apr 12 16:24:31.910564 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 427/852] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:31 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:32.145910 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1ae10501-a0f1-48ce-a5cc-3e68509bc167 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:32.146567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1ae10501-a0f1-48ce-a5cc-3e68509bc167 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:32.153172 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ae10501-a0f1-48ce-a5cc-3e68509bc167 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:32.153620 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ae10501-a0f1-48ce-a5cc-3e68509bc167 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:32.154526 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ae10501-a0f1-48ce-a5cc-3e68509bc167 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:32.154994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1ae10501-a0f1-48ce-a5cc-3e68509bc167 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:32.302180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1ae10501-a0f1-48ce-a5cc-3e68509bc167 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:32.314008 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1ae10501-a0f1-48ce-a5cc-3e68509bc167 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1576 microversion: 2.1 time: 0.171720 Apr 12 16:24:32.314920 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 426/853] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:32 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:32.633041 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-49220aad-747a-4ee6-9923-3546818b40ac tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:32.633663 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-49220aad-747a-4ee6-9923-3546818b40ac tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:32.640556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-49220aad-747a-4ee6-9923-3546818b40ac tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:32.641011 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-49220aad-747a-4ee6-9923-3546818b40ac tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:32.641781 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-49220aad-747a-4ee6-9923-3546818b40ac tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:32.642273 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-49220aad-747a-4ee6-9923-3546818b40ac tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:32.755939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-12402bdd-dec7-43a6-bf0c-2682656c737b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:32.756562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-12402bdd-dec7-43a6-bf0c-2682656c737b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:32.763277 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12402bdd-dec7-43a6-bf0c-2682656c737b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:32.763776 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12402bdd-dec7-43a6-bf0c-2682656c737b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:32.764703 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12402bdd-dec7-43a6-bf0c-2682656c737b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:32.765118 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-12402bdd-dec7-43a6-bf0c-2682656c737b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:32.775288 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-49220aad-747a-4ee6-9923-3546818b40ac tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:32.783835 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-49220aad-747a-4ee6-9923-3546818b40ac tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.154768 Apr 12 16:24:32.784436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 428/854] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:32 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:32.928399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:32.929041 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:32.935289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:32.935743 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:32.936511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:32.936964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:32.944913 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-12402bdd-dec7-43a6-bf0c-2682656c737b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:32.952761 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-12402bdd-dec7-43a6-bf0c-2682656c737b tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1554 microversion: 2.1 time: 0.201117 Apr 12 16:24:32.953714 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 427/855] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:32 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:33.072462 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:33.080898 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:33.082424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:33.083596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9fe69019-0b8c-44a6-aa24-382c09c42fbc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.159282 Apr 12 16:24:33.084167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 429/856] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:32 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:33.339175 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c8f9fdc5-f9c6-4ce8-9a85-37c13267194b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:33.340176 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c8f9fdc5-f9c6-4ce8-9a85-37c13267194b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:33.347690 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdc5-f9c6-4ce8-9a85-37c13267194b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:33.348136 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdc5-f9c6-4ce8-9a85-37c13267194b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:33.348900 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdc5-f9c6-4ce8-9a85-37c13267194b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:33.349324 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c8f9fdc5-f9c6-4ce8-9a85-37c13267194b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:33.495707 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c8f9fdc5-f9c6-4ce8-9a85-37c13267194b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:33.504392 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c8f9fdc5-f9c6-4ce8-9a85-37c13267194b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1576 microversion: 2.1 time: 0.171398 Apr 12 16:24:33.510174 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 428/857] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:33 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:33.802691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a081a3a9-f122-4e0b-89fd-96681b820420 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:33.803394 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a081a3a9-f122-4e0b-89fd-96681b820420 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:33.810968 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a081a3a9-f122-4e0b-89fd-96681b820420 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:33.811442 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a081a3a9-f122-4e0b-89fd-96681b820420 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:33.812247 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a081a3a9-f122-4e0b-89fd-96681b820420 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:33.812701 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a081a3a9-f122-4e0b-89fd-96681b820420 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:33.953952 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a081a3a9-f122-4e0b-89fd-96681b820420 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:33.961982 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a081a3a9-f122-4e0b-89fd-96681b820420 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.163636 Apr 12 16:24:33.962623 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 430/858] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:33 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:33.970572 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-dd1061bf-b2b2-4eca-819b-e73d6bbf7897 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:33.971381 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-dd1061bf-b2b2-4eca-819b-e73d6bbf7897 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:33.981131 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dd1061bf-b2b2-4eca-819b-e73d6bbf7897 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:33.981961 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dd1061bf-b2b2-4eca-819b-e73d6bbf7897 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:33.983013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dd1061bf-b2b2-4eca-819b-e73d6bbf7897 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:33.983450 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dd1061bf-b2b2-4eca-819b-e73d6bbf7897 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:34.108726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:34.110072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:34.116905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:34.117071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dd1061bf-b2b2-4eca-819b-e73d6bbf7897 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:34.117773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:34.118792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:34.119422 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:34.125163 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-dd1061bf-b2b2-4eca-819b-e73d6bbf7897 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1554 microversion: 2.1 time: 0.158459 Apr 12 16:24:34.125889 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 429/859] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:33 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:34.268153 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:34.276762 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:34.278297 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:34.279566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3ebdd465-b7af-45c4-89a0-c933313568ae tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.175415 Apr 12 16:24:34.280139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 431/860] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:34 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:34.524258 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9f502637-cfc2-43db-a3d2-93ea17a7a028 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:34.524861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9f502637-cfc2-43db-a3d2-93ea17a7a028 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:34.531133 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9f502637-cfc2-43db-a3d2-93ea17a7a028 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:34.531578 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9f502637-cfc2-43db-a3d2-93ea17a7a028 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:34.532335 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9f502637-cfc2-43db-a3d2-93ea17a7a028 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:34.532763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9f502637-cfc2-43db-a3d2-93ea17a7a028 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:34.671039 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9f502637-cfc2-43db-a3d2-93ea17a7a028 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:34.678748 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9f502637-cfc2-43db-a3d2-93ea17a7a028 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1576 microversion: 2.1 time: 0.158466 Apr 12 16:24:34.688072 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 430/861] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:34 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:34.978731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f5b27cb5-92ba-4274-880f-0f4acf4c4115 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:34.979869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f5b27cb5-92ba-4274-880f-0f4acf4c4115 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:34.986183 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-d4e90bc5-7144-45bc-90de-a1a9887dadbe req-9d075f1c-d93b-4737-a6c9-832db80c194d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f48c36-5e37-4640-b589-df261265d809", "name": "network-vif-unplugged", "status": "completed", "tag": "aaca632c-41bc-43f8-8889-7aea0e458ffa"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:34.987278 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f5b27cb5-92ba-4274-880f-0f4acf4c4115 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:34.987961 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f5b27cb5-92ba-4274-880f-0f4acf4c4115 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:34.988991 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f5b27cb5-92ba-4274-880f-0f4acf4c4115 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:34.989629 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f5b27cb5-92ba-4274-880f-0f4acf4c4115 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:34.994792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-d4e90bc5-7144-45bc-90de-a1a9887dadbe req-9d075f1c-d93b-4737-a6c9-832db80c194d service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:34.994792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-d4e90bc5-7144-45bc-90de-a1a9887dadbe req-9d075f1c-d93b-4737-a6c9-832db80c194d service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:35.010338 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-d4e90bc5-7144-45bc-90de-a1a9887dadbe req-9d075f1c-d93b-4737-a6c9-832db80c194d service nova] Creating event network-vif-unplugged:aaca632c-41bc-43f8-8889-7aea0e458ffa for instance 29f48c36-5e37-4640-b589-df261265d809 on hv-cinder-83752 Apr 12 16:24:35.019318 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-d4e90bc5-7144-45bc-90de-a1a9887dadbe req-9d075f1c-d93b-4737-a6c9-832db80c194d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111866 Apr 12 16:24:35.020181 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 432/862] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:24:35.142411 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-052a560d-6f85-4938-adea-bac6a30b0c84 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:35.143137 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-052a560d-6f85-4938-adea-bac6a30b0c84 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:35.150374 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-052a560d-6f85-4938-adea-bac6a30b0c84 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:35.150834 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-052a560d-6f85-4938-adea-bac6a30b0c84 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:35.151637 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-052a560d-6f85-4938-adea-bac6a30b0c84 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:35.152074 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-052a560d-6f85-4938-adea-bac6a30b0c84 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:35.516252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f5b27cb5-92ba-4274-880f-0f4acf4c4115 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:35.524563 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f5b27cb5-92ba-4274-880f-0f4acf4c4115 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.549818 Apr 12 16:24:35.525154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 431/863] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:34 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:35.529980 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:35.530644 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:35.536538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:35.537246 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:35.538061 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:35.538506 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:35.663913 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-052a560d-6f85-4938-adea-bac6a30b0c84 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:35.671917 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-052a560d-6f85-4938-adea-bac6a30b0c84 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1554 microversion: 2.1 time: 0.533867 Apr 12 16:24:35.672716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 433/864] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:35 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1554 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:35.696761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-620d66f4-efa6-4467-b41b-63dae0ac0250 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:35.697396 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-620d66f4-efa6-4467-b41b-63dae0ac0250 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:35.704245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-620d66f4-efa6-4467-b41b-63dae0ac0250 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:35.704696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-620d66f4-efa6-4467-b41b-63dae0ac0250 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:35.705471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-620d66f4-efa6-4467-b41b-63dae0ac0250 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:35.706743 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-620d66f4-efa6-4467-b41b-63dae0ac0250 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:36.207885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:36.216223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:36.217968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:36.219182 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0b37e30f-08bc-4415-8ed8-a08f251e3e94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1723 microversion: 2.20 time: 0.693125 Apr 12 16:24:36.219761 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 432/865] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:35 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1723 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:36.279251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-620d66f4-efa6-4467-b41b-63dae0ac0250 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:36.287328 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-620d66f4-efa6-4467-b41b-63dae0ac0250 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1576 microversion: 2.1 time: 0.594469 Apr 12 16:24:36.287940 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 434/866] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:35 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1576 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:36.531618 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-4be1f2ef-8103-47b1-8d51-82a4a14b9e5e req-192c5829-7fd1-4c43-a67b-855fdf2900e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74711e3a-cd18-4260-b9d1-7f393f377971", "name": "network-vif-deleted", "tag": "94c5c57b-adf1-460f-930c-36fd03392889"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:36.539938 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-4be1f2ef-8103-47b1-8d51-82a4a14b9e5e req-192c5829-7fd1-4c43-a67b-855fdf2900e1 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:36.540473 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-4be1f2ef-8103-47b1-8d51-82a4a14b9e5e req-192c5829-7fd1-4c43-a67b-855fdf2900e1 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:36.542167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4674939e-f84b-4c5a-904a-4d68493f48a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:36.542807 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4674939e-f84b-4c5a-904a-4d68493f48a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:36.549005 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4674939e-f84b-4c5a-904a-4d68493f48a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:36.549464 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4674939e-f84b-4c5a-904a-4d68493f48a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:36.550323 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4674939e-f84b-4c5a-904a-4d68493f48a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:36.550890 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4674939e-f84b-4c5a-904a-4d68493f48a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:36.552970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-4be1f2ef-8103-47b1-8d51-82a4a14b9e5e req-192c5829-7fd1-4c43-a67b-855fdf2900e1 service nova] Creating event network-vif-deleted:94c5c57b-adf1-460f-930c-36fd03392889 for instance 74711e3a-cd18-4260-b9d1-7f393f377971 on hv-cinder-83752 Apr 12 16:24:36.559382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-4be1f2ef-8103-47b1-8d51-82a4a14b9e5e req-192c5829-7fd1-4c43-a67b-855fdf2900e1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031685 Apr 12 16:24:36.560330 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 433/867] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:36.691927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:36.692541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:36.699717 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:36.700560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:36.701716 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:36.703074 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:36.741012 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:36.741632 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:36.742700 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lazy-loading 'fault' on Instance uuid 74711e3a-cd18-4260-b9d1-7f393f377971 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:24:36.896699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3630119bdbb4f70a060a355dd14f44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91e85c02b6e47d9913792e1168a8939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:36.907256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-940bfc09-0847-4bcd-b7fb-4079cd20677a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 200 len: 1348 microversion: 2.1 time: 0.222075 Apr 12 16:24:36.908318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 434/868] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:36 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 1348 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:36.951742 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4674939e-f84b-4c5a-904a-4d68493f48a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:36.960714 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4674939e-f84b-4c5a-904a-4d68493f48a1 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.422490 Apr 12 16:24:36.961314 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 435/869] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:36 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:37.046585 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-d78e980e-4076-45be-b4be-85ec1451f194 req-a5df000e-5cb5-42b5-88ca-41ea5eddda5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74711e3a-cd18-4260-b9d1-7f393f377971", "name": "network-vif-unplugged", "status": "completed", "tag": "94c5c57b-adf1-460f-930c-36fd03392889"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:37.055419 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-d78e980e-4076-45be-b4be-85ec1451f194 req-a5df000e-5cb5-42b5-88ca-41ea5eddda5c service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.055876 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-d78e980e-4076-45be-b4be-85ec1451f194 req-a5df000e-5cb5-42b5-88ca-41ea5eddda5c service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.067600 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-d78e980e-4076-45be-b4be-85ec1451f194 req-a5df000e-5cb5-42b5-88ca-41ea5eddda5c service nova] Creating event network-vif-unplugged:94c5c57b-adf1-460f-930c-36fd03392889 for instance 74711e3a-cd18-4260-b9d1-7f393f377971 on hv-cinder-83752 Apr 12 16:24:37.072877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-d78e980e-4076-45be-b4be-85ec1451f194 req-a5df000e-5cb5-42b5-88ca-41ea5eddda5c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030560 Apr 12 16:24:37.073516 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 435/870] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:37.237430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:37.238571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:37.248398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.254391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.256874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.257934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.306016 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1a486538-8684-4db2-a683-9f68b31c6c8b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:37.307526 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1a486538-8684-4db2-a683-9f68b31c6c8b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:37.311619 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.312311 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.312875 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lazy-loading 'fault' on Instance uuid 29f48c36-5e37-4640-b589-df261265d809 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:24:37.315624 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1a486538-8684-4db2-a683-9f68b31c6c8b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.316706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1a486538-8684-4db2-a683-9f68b31c6c8b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.318208 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1a486538-8684-4db2-a683-9f68b31c6c8b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.318794 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1a486538-8684-4db2-a683-9f68b31c6c8b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.399669 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:37.407973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:37.409457 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:37.410660 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6e64491b-40b8-4ebe-b767-e13dbd12e231 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1370 microversion: 2.20 time: 0.177504 Apr 12 16:24:37.411225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 436/871] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:37 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:37.560543 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1a486538-8684-4db2-a683-9f68b31c6c8b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:37.572479 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1a486538-8684-4db2-a683-9f68b31c6c8b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1576 microversion: 2.1 time: 0.270821 Apr 12 16:24:37.584734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 436/872] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:37 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1576 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:37.924845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:37.925457 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] [instance: 74711e3a-cd18-4260-b9d1-7f393f377971] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:37.931961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.932446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.933214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.933645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.949322 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] HTTP exception thrown: Instance 74711e3a-cd18-4260-b9d1-7f393f377971 could not be found. Apr 12 16:24:37.950066 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Returning 404 to user: Instance 74711e3a-cd18-4260-b9d1-7f393f377971 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:24:37.951047 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0a910866-6144-4cc7-8d86-d14b1131ada4 tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971" status: 404 len: 111 microversion: 2.1 time: 0.030145 Apr 12 16:24:37.951793 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 437/873] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:37 2022] GET /compute/v2.1/servers/74711e3a-cd18-4260-b9d1-7f393f377971 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:37.961275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9343de48-eec0-4268-9eaa-b54ff596600a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] Calling method '.version_select at 0x7f246dacf820>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:37.978996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3c6c62a5-d8a5-46c2-b4ef-5a53a979dc39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:37.979967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3c6c62a5-d8a5-46c2-b4ef-5a53a979dc39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:37.986627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3c6c62a5-d8a5-46c2-b4ef-5a53a979dc39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.986919 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9343de48-eec0-4268-9eaa-b54ff596600a tempest-TestMinimumBasicScenario-2140704287 tempest-TestMinimumBasicScenario-2140704287-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-268036333" status: 202 len: 0 microversion: 2.1 time: 0.029324 Apr 12 16:24:37.987560 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3c6c62a5-d8a5-46c2-b4ef-5a53a979dc39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:37.990840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 437/874] 10.222.0.67 () {58 vars in 1268 bytes} [Tue Apr 12 16:24:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-268036333 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:24:37.991069 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3c6c62a5-d8a5-46c2-b4ef-5a53a979dc39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:37.991069 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3c6c62a5-d8a5-46c2-b4ef-5a53a979dc39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:38.268204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3c6c62a5-d8a5-46c2-b4ef-5a53a979dc39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:38.279630 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3c6c62a5-d8a5-46c2-b4ef-5a53a979dc39 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1736 microversion: 2.1 time: 0.305096 Apr 12 16:24:38.282207 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 438/875] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:37 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1736 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:38.429793 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:38.431103 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:38.443220 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:38.443571 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:38.446306 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:38.446763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:38.510049 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:38.510617 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:38.511269 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lazy-loading 'fault' on Instance uuid 29f48c36-5e37-4640-b589-df261265d809 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:24:38.583070 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:38.583699 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-3ae0c71c-2460-46fb-8ae6-d508247ff9e2 req-2ba7bb92-f511-4b19-ac86-7ce2a8794129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f48c36-5e37-4640-b589-df261265d809", "name": "network-vif-deleted", "tag": "aaca632c-41bc-43f8-8889-7aea0e458ffa"}, {"server_uuid": "a439a34a-3d5a-48a4-8f9c-adbf98011c79", "name": "network-vif-deleted", "tag": "deda406a-1751-4df5-995b-7f40d3fcb82e"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:38.593436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-3ae0c71c-2460-46fb-8ae6-d508247ff9e2 req-2ba7bb92-f511-4b19-ac86-7ce2a8794129 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:38.593886 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-3ae0c71c-2460-46fb-8ae6-d508247ff9e2 req-2ba7bb92-f511-4b19-ac86-7ce2a8794129 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:38.601974 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:38.604236 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:38.605484 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4ea1b7ec-b1d1-4dbe-9a28-b74291765286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 200 len: 1370 microversion: 2.20 time: 0.180320 Apr 12 16:24:38.606403 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 438/876] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:38 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:38.611146 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b53debaa-db16-463c-8051-8707d968fb30 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:38.612006 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b53debaa-db16-463c-8051-8707d968fb30 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:38.620099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-3ae0c71c-2460-46fb-8ae6-d508247ff9e2 req-2ba7bb92-f511-4b19-ac86-7ce2a8794129 service nova] Creating event network-vif-deleted:aaca632c-41bc-43f8-8889-7aea0e458ffa for instance 29f48c36-5e37-4640-b589-df261265d809 on hv-cinder-83752 Apr 12 16:24:38.620607 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-3ae0c71c-2460-46fb-8ae6-d508247ff9e2 req-2ba7bb92-f511-4b19-ac86-7ce2a8794129 service nova] Creating event network-vif-deleted:deda406a-1751-4df5-995b-7f40d3fcb82e for instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 on hv-cinder-83752 Apr 12 16:24:38.623111 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b53debaa-db16-463c-8051-8707d968fb30 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:38.623562 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b53debaa-db16-463c-8051-8707d968fb30 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:38.626244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b53debaa-db16-463c-8051-8707d968fb30 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:38.626704 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b53debaa-db16-463c-8051-8707d968fb30 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:38.634756 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-3ae0c71c-2460-46fb-8ae6-d508247ff9e2 req-2ba7bb92-f511-4b19-ac86-7ce2a8794129 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058606 Apr 12 16:24:38.645721 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 439/877] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:38.696233 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b53debaa-db16-463c-8051-8707d968fb30 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:38.706746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b53debaa-db16-463c-8051-8707d968fb30 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1225 microversion: 2.1 time: 0.099105 Apr 12 16:24:38.707579 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 439/878] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:38 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:39.304755 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5c8e7fa7-2fd3-4a01-a6f6-b5757079d872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:39.305915 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5c8e7fa7-2fd3-4a01-a6f6-b5757079d872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:39.312568 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c8e7fa7-2fd3-4a01-a6f6-b5757079d872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.313297 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c8e7fa7-2fd3-4a01-a6f6-b5757079d872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.314190 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c8e7fa7-2fd3-4a01-a6f6-b5757079d872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.314689 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c8e7fa7-2fd3-4a01-a6f6-b5757079d872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.587452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c8e7fa7-2fd3-4a01-a6f6-b5757079d872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:39.595972 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5c8e7fa7-2fd3-4a01-a6f6-b5757079d872 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1716 microversion: 2.1 time: 0.297807 Apr 12 16:24:39.596666 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 440/879] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:39 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1716 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:39.626206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:39.626987 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:39.633600 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.634252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.635371 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.635926 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.652474 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] HTTP exception thrown: Instance 29f48c36-5e37-4640-b589-df261265d809 could not be found. Apr 12 16:24:39.653346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Returning 404 to user: Instance 29f48c36-5e37-4640-b589-df261265d809 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:24:39.654465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2386258d-103c-4326-b01d-1ef6aea69e11 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 404 len: 111 microversion: 2.20 time: 0.032480 Apr 12 16:24:39.659364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 440/880] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:39 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:24:39.665053 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6c5d7619-a65a-492c-85d0-9b5133401f14 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '.version_select at 0x7f246dcec040>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:39.689182 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6c5d7619-a65a-492c-85d0-9b5133401f14 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-478533550" status: 204 len: 0 microversion: 2.20 time: 0.028668 Apr 12 16:24:39.690225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 441/881] 10.222.0.67 () {60 vars in 1258 bytes} [Tue Apr 12 16:24:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-478533550 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:24:39.727427 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:39.728552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:39.742846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:39.743666 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:39.754152 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.754871 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.755426 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.755856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.756302 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.756417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.757398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.758449 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.791954 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.792341 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.792805 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lazy-loading 'fault' on Instance uuid a439a34a-3d5a-48a4-8f9c-adbf98011c79 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:24:39.862796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] HTTP exception thrown: Cannot 'detach_volume' instance b37fad20-9d1f-4785-ac0d-9babf6466375 while it is in vm_state rescued Apr 12 16:24:39.863403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Returning 409 to user: Cannot 'detach_volume' instance b37fad20-9d1f-4785-ac0d-9babf6466375 while it is in vm_state rescued {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:24:39.864363 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c3bd250a-a7c8-4cbd-a054-bbb15b1cf344 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments/8c871263-1ea2-49f7-836f-b517510ed74f" status: 409 len: 152 microversion: 2.1 time: 0.125651 Apr 12 16:24:39.864879 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 442/882] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:24:39 2022] DELETE /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments/8c871263-1ea2-49f7-836f-b517510ed74f => generated 152 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 16:24:39.874481 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6f668e37-1f6b-4807-9b31-21a66741c0cb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:39.875033 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-6f668e37-1f6b-4807-9b31-21a66741c0cb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:39.881457 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f668e37-1f6b-4807-9b31-21a66741c0cb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.881911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f668e37-1f6b-4807-9b31-21a66741c0cb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.882773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f668e37-1f6b-4807-9b31-21a66741c0cb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.883224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-6f668e37-1f6b-4807-9b31-21a66741c0cb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.929062 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:39.937880 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-922d6316-7a70-4783-98c5-ec642a38282b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 200 len: 1230 microversion: 2.1 time: 0.215202 Apr 12 16:24:39.949764 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 441/883] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:39 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 1230 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:39.964491 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6f668e37-1f6b-4807-9b31-21a66741c0cb tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "POST /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/action" status: 202 len: 0 microversion: 2.1 time: 0.094056 Apr 12 16:24:39.968559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 443/884] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:24:39 2022] POST /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:24:39.973711 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-92b71c64-0f23-451e-a623-8aa62879c1cd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:39.974433 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-92b71c64-0f23-451e-a623-8aa62879c1cd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:39.980478 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-92b71c64-0f23-451e-a623-8aa62879c1cd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.981259 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-92b71c64-0f23-451e-a623-8aa62879c1cd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:39.982235 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-92b71c64-0f23-451e-a623-8aa62879c1cd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:39.982932 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-92b71c64-0f23-451e-a623-8aa62879c1cd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:40.293466 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-92b71c64-0f23-451e-a623-8aa62879c1cd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:40.302859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-92b71c64-0f23-451e-a623-8aa62879c1cd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1724 microversion: 2.1 time: 0.332928 Apr 12 16:24:40.303635 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 442/885] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:39 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:40.426368 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7049e706-3572-40ad-a78b-3e07e6e7aac5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'create', calling method: .version_select at 0x7f246e53cf70>, body: {"keypair": {"name": "tempest-keypair-327994734"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:40.441075 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-7049e706-3572-40ad-a78b-3e07e6e7aac5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:24:40.445280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-7049e706-3572-40ad-a78b-3e07e6e7aac5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for user ff1435d492ce4751a0b4eac7558ad9d6 and project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:24:40.623047 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-7049e706-3572-40ad-a78b-3e07e6e7aac5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:24:40.626754 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-7049e706-3572-40ad-a78b-3e07e6e7aac5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for user ff1435d492ce4751a0b4eac7558ad9d6 and project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:24:40.639671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7049e706-3572-40ad-a78b-3e07e6e7aac5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.218893 Apr 12 16:24:40.640392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 444/886] 10.222.0.67 () {62 vars in 1198 bytes} [Tue Apr 12 16:24:40 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 220 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:24:40.956825 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:40.957351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:40.964331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:40.964908 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:40.965828 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:40.966605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:40.982021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] HTTP exception thrown: Instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 could not be found. Apr 12 16:24:40.982758 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Returning 404 to user: Instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:24:40.983685 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bc6dacc3-8f86-47ff-b49d-d5469277f2f8 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 404 len: 111 microversion: 2.1 time: 0.032295 Apr 12 16:24:40.984334 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 443/887] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:40 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:24:41.093505 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1087637893", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-944614855", "security_groups": [{"name": "tempest-secgroup-smoke-93198052"}], "block_device_mapping_v2": [{"uuid": "63f0f36c-357e-48b8-9a35-351fd62499dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46b7a5ea-cc45-4b33-bcf1-fa2441d5a8b0"}]}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:41.282413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.network.neutron [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] validate_networks() for [('46b7a5ea-cc45-4b33-bcf1-fa2441d5a8b0', None, None, None, None, None)] {{(pid=117202) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:24:41.320681 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-17f321fd-3214-47b5-a9db-248e933e4d8e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:41.321293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-17f321fd-3214-47b5-a9db-248e933e4d8e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:41.328404 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-17f321fd-3214-47b5-a9db-248e933e4d8e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:41.328951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-17f321fd-3214-47b5-a9db-248e933e4d8e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:41.329620 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-17f321fd-3214-47b5-a9db-248e933e4d8e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:41.330031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-17f321fd-3214-47b5-a9db-248e933e4d8e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:41.634308 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-17f321fd-3214-47b5-a9db-248e933e4d8e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:41.643340 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-17f321fd-3214-47b5-a9db-248e933e4d8e tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1724 microversion: 2.1 time: 0.326577 Apr 12 16:24:41.643883 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 444/888] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:41 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:42.073173 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Flavor limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:24:42.073779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Image limits 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:24:42.074167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Flavor pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:24:42.074603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Image pref 0:0:0 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:24:42.075039 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.virt.hardware [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117202) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:24:42.090705 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:42.090705 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:42.096578 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:42.097207 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:42.110813 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-763589811", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "659bb59b-3f11-4e82-88df-ec448e9e7e28"}], "security_groups": [{"name": "tempest-securitygroup--1112232937"}], "key_name": "tempest-keypair-327994734", "user_data": "}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:42.122700 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for project 9efdb664508148aab946b17b16013559. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:24:42.129293 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for user b72b05bd57f241128f065c0b94663f6d and project 9efdb664508148aab946b17b16013559. Resources: {'cores', 'ram', 'instances'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:24:42.211642 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Going to run 1 instances... {{(pid=117202) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:24:42.213947 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63f0f36c-357e-48b8-9a35-351fd62499dc',volume_size=None,volume_type=None)] {{(pid=117202) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:24:42.272067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] validate_networks() for [('659bb59b-3f11-4e82-88df-ec448e9e7e28', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:24:42.348691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4b073d28-58d1-4bc7-a2b5-7e77daf68759 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.261153 Apr 12 16:24:42.349648 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 445/889] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:24:41 2022] POST /compute/v2.1/servers => generated 404 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:24:42.361329 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0d7189f9-47e1-4842-9271-bbdf136d90f9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:42.362019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0d7189f9-47e1-4842-9271-bbdf136d90f9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:42.732711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0d7189f9-47e1-4842-9271-bbdf136d90f9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:42.740408 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0d7189f9-47e1-4842-9271-bbdf136d90f9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1094 microversion: 2.1 time: 0.384021 Apr 12 16:24:42.741733 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 446/890] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:42 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1094 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:42.753365 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7d50da09-5368-40c9-b8fc-14a4d6f065bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:42.754098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7d50da09-5368-40c9-b8fc-14a4d6f065bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:42.761108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d50da09-5368-40c9-b8fc-14a4d6f065bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:42.761528 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d50da09-5368-40c9-b8fc-14a4d6f065bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:42.762346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d50da09-5368-40c9-b8fc-14a4d6f065bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:42.762872 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d50da09-5368-40c9-b8fc-14a4d6f065bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:43.057566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7d50da09-5368-40c9-b8fc-14a4d6f065bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:43.066862 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7d50da09-5368-40c9-b8fc-14a4d6f065bd tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1724 microversion: 2.1 time: 0.323863 Apr 12 16:24:43.067410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 447/891] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:42 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:43.340180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:24:43.340656 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:24:43.341137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:24:43.341829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:24:43.342284 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:24:43.351937 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:43.351937 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:43.352563 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:43.352998 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:43.369806 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:24:43.376028 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Getting quotas for user ff1435d492ce4751a0b4eac7558ad9d6 and project 45e8e703a32d4ac4be28bb7018de850f. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:24:43.387682 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:24:43.390102 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:24:43.438971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2681cf21-4bd3-4512-85b6-46d18a0a8677 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.344706 Apr 12 16:24:43.439965 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 445/892] 10.222.0.67 () {62 vars in 1187 bytes} [Tue Apr 12 16:24:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 12 16:24:43.450479 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-fcaa606e-e55a-473a-b39d-ca4fd4e6eb07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:43.451102 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-fcaa606e-e55a-473a-b39d-ca4fd4e6eb07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:43.552966 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-fcaa606e-e55a-473a-b39d-ca4fd4e6eb07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:43.563379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-fcaa606e-e55a-473a-b39d-ca4fd4e6eb07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:43.564866 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-fcaa606e-e55a-473a-b39d-ca4fd4e6eb07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:43.565978 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-fcaa606e-e55a-473a-b39d-ca4fd4e6eb07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1280 microversion: 2.20 time: 0.120008 Apr 12 16:24:43.566826 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 448/893] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:43 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:43.758601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-53e87ed5-526d-488a-8991-5620dd222c35 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:43.759648 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-53e87ed5-526d-488a-8991-5620dd222c35 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:43.766410 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53e87ed5-526d-488a-8991-5620dd222c35 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:43.767409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53e87ed5-526d-488a-8991-5620dd222c35 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:43.768833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53e87ed5-526d-488a-8991-5620dd222c35 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:43.769328 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-53e87ed5-526d-488a-8991-5620dd222c35 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:43.852816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-53e87ed5-526d-488a-8991-5620dd222c35 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:43.861054 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-53e87ed5-526d-488a-8991-5620dd222c35 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1192 microversion: 2.1 time: 0.107139 Apr 12 16:24:43.862063 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 446/894] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:43 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:44.084303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-09556477-e34c-4af1-bf98-4949b7a9160d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:44.084916 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-09556477-e34c-4af1-bf98-4949b7a9160d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:44.091799 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09556477-e34c-4af1-bf98-4949b7a9160d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:44.092251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09556477-e34c-4af1-bf98-4949b7a9160d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:44.093032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09556477-e34c-4af1-bf98-4949b7a9160d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:44.093469 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09556477-e34c-4af1-bf98-4949b7a9160d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:44.237946 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-09556477-e34c-4af1-bf98-4949b7a9160d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:44.250234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-09556477-e34c-4af1-bf98-4949b7a9160d tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1730 microversion: 2.1 time: 0.169630 Apr 12 16:24:44.254575 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 449/895] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:44 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:44.270327 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f2879671-650f-4ab6-9dfc-c772879c5370 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:44.270828 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f2879671-650f-4ab6-9dfc-c772879c5370 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:44.277589 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f2879671-650f-4ab6-9dfc-c772879c5370 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:44.279000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f2879671-650f-4ab6-9dfc-c772879c5370 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:44.280285 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f2879671-650f-4ab6-9dfc-c772879c5370 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:44.280890 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f2879671-650f-4ab6-9dfc-c772879c5370 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:44.362457 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f2879671-650f-4ab6-9dfc-c772879c5370 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097830 Apr 12 16:24:44.363731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 447/896] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Apr 12 16:24:44 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:24:44.585784 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:44.587224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:44.607018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:44.607942 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:44.609450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:44.611173 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:44.745085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:44.754471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:44.756222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:44.757414 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e48ec584-2d64-45c2-8916-429e444f41c2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1276 microversion: 2.20 time: 0.176036 Apr 12 16:24:44.768402 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 450/897] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:44 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:44.879539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-74b1a8b4-2fa4-4cc6-bf30-83ecaca22a43 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:44.880148 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-74b1a8b4-2fa4-4cc6-bf30-83ecaca22a43 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:44.886257 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-74b1a8b4-2fa4-4cc6-bf30-83ecaca22a43 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:44.886789 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-74b1a8b4-2fa4-4cc6-bf30-83ecaca22a43 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:44.887879 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-74b1a8b4-2fa4-4cc6-bf30-83ecaca22a43 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:44.888400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-74b1a8b4-2fa4-4cc6-bf30-83ecaca22a43 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:44.991107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-74b1a8b4-2fa4-4cc6-bf30-83ecaca22a43 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:45.001403 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-74b1a8b4-2fa4-4cc6-bf30-83ecaca22a43 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1210 microversion: 2.1 time: 0.126023 Apr 12 16:24:45.002103 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 448/898] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:44 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:45.777908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:45.779375 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:45.786905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:45.787715 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:45.788676 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:45.789336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:46.019404 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-38341e0c-b49a-451c-9767-63c3aa0a7115 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:46.020862 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-38341e0c-b49a-451c-9767-63c3aa0a7115 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:46.028129 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-38341e0c-b49a-451c-9767-63c3aa0a7115 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:46.028730 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-38341e0c-b49a-451c-9767-63c3aa0a7115 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:46.029621 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-38341e0c-b49a-451c-9767-63c3aa0a7115 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:46.030150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-38341e0c-b49a-451c-9767-63c3aa0a7115 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:46.084097 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:46.094020 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:46.096655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:46.098057 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-377f4e2b-c0dd-48e0-aabe-2072d68b6584 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1338 microversion: 2.20 time: 0.324888 Apr 12 16:24:46.098620 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 451/899] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:45 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1338 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:46.135510 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-38341e0c-b49a-451c-9767-63c3aa0a7115 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:46.144827 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-38341e0c-b49a-451c-9767-63c3aa0a7115 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1198 microversion: 2.1 time: 0.129414 Apr 12 16:24:46.146154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 449/900] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:46 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:46.237424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-2f09e681-834f-42f1-9fec-5dee0720c514 req-29eaedca-8fb4-495f-a722-a0bedc41bc0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37fad20-9d1f-4785-ac0d-9babf6466375", "tag": "a9b6c507-f16a-4011-8719-2d8d34825c2a"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:46.253534 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-2f09e681-834f-42f1-9fec-5dee0720c514 req-29eaedca-8fb4-495f-a722-a0bedc41bc0c service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:46.254358 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-2f09e681-834f-42f1-9fec-5dee0720c514 req-29eaedca-8fb4-495f-a722-a0bedc41bc0c service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:46.274714 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-2f09e681-834f-42f1-9fec-5dee0720c514 req-29eaedca-8fb4-495f-a722-a0bedc41bc0c service nova] Creating event network-changed:a9b6c507-f16a-4011-8719-2d8d34825c2a for instance b37fad20-9d1f-4785-ac0d-9babf6466375 on hv-cinder-83752 Apr 12 16:24:46.283049 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-2f09e681-834f-42f1-9fec-5dee0720c514 req-29eaedca-8fb4-495f-a722-a0bedc41bc0c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052524 Apr 12 16:24:46.284268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 452/901] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:47.118386 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:47.119013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:47.132968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:47.144143 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:47.145014 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:47.145458 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:47.163476 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ae2a63a7-3fe0-4e84-aec5-930958312e5b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:47.164252 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ae2a63a7-3fe0-4e84-aec5-930958312e5b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:47.176659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae2a63a7-3fe0-4e84-aec5-930958312e5b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:47.177281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae2a63a7-3fe0-4e84-aec5-930958312e5b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:47.181232 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae2a63a7-3fe0-4e84-aec5-930958312e5b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:47.181954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae2a63a7-3fe0-4e84-aec5-930958312e5b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:47.551789 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:47.562756 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:47.564885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:47.571490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ae2a63a7-3fe0-4e84-aec5-930958312e5b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:47.577024 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-49ca404c-ec51-4b46-983a-b09d77ec2234 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.454711 Apr 12 16:24:47.593315 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 450/902] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:47 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:47.596716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ae2a63a7-3fe0-4e84-aec5-930958312e5b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.437771 Apr 12 16:24:47.597968 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 453/903] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:47 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:48.334604 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-fd28d865-96e3-44d3-af46-204281531c35 req-48075c6d-a428-46eb-bd93-a69184fdb884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37fad20-9d1f-4785-ac0d-9babf6466375", "tag": "a9b6c507-f16a-4011-8719-2d8d34825c2a"}, {"name": "network-changed", "server_uuid": "842d987b-d6f3-432b-b6e5-311a36e9ba0a", "tag": "60428b9a-7b1b-43fb-8999-73bc88945670"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:48.350277 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-fd28d865-96e3-44d3-af46-204281531c35 req-48075c6d-a428-46eb-bd93-a69184fdb884 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:48.351273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-fd28d865-96e3-44d3-af46-204281531c35 req-48075c6d-a428-46eb-bd93-a69184fdb884 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:48.369418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-fd28d865-96e3-44d3-af46-204281531c35 req-48075c6d-a428-46eb-bd93-a69184fdb884 service nova] Creating event network-changed:a9b6c507-f16a-4011-8719-2d8d34825c2a for instance b37fad20-9d1f-4785-ac0d-9babf6466375 on hv-cinder-83752 Apr 12 16:24:48.370260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-fd28d865-96e3-44d3-af46-204281531c35 req-48075c6d-a428-46eb-bd93-a69184fdb884 service nova] Creating event network-changed:60428b9a-7b1b-43fb-8999-73bc88945670 for instance 842d987b-d6f3-432b-b6e5-311a36e9ba0a on hv-cinder-83752 Apr 12 16:24:48.378280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-fd28d865-96e3-44d3-af46-204281531c35 req-48075c6d-a428-46eb-bd93-a69184fdb884 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048800 Apr 12 16:24:48.379524 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 451/904] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:24:48.599933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:48.601466 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:48.626544 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:48.629490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:48.640896 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:48.641518 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:48.704473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-872371de-1004-4e75-9de5-1df6c26429f0 req-f9f35644-455c-4ef8-92a6-6ecc406c6946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79e2e80-5679-41bd-aab2-6e740d404eb7", "tag": "ea4a126a-a7f5-4e56-928d-bd76dc66e823"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:48.721899 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-872371de-1004-4e75-9de5-1df6c26429f0 req-f9f35644-455c-4ef8-92a6-6ecc406c6946 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:48.722377 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-872371de-1004-4e75-9de5-1df6c26429f0 req-f9f35644-455c-4ef8-92a6-6ecc406c6946 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:48.746682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-872371de-1004-4e75-9de5-1df6c26429f0 req-f9f35644-455c-4ef8-92a6-6ecc406c6946 service nova] Creating event network-changed:ea4a126a-a7f5-4e56-928d-bd76dc66e823 for instance d79e2e80-5679-41bd-aab2-6e740d404eb7 on hv-cinder-83752 Apr 12 16:24:48.758698 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-872371de-1004-4e75-9de5-1df6c26429f0 req-f9f35644-455c-4ef8-92a6-6ecc406c6946 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235887 Apr 12 16:24:48.759626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 454/905] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:48.767021 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-278b78cd-4930-4285-b3ec-eb626d60b3fe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:48.768804 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-278b78cd-4930-4285-b3ec-eb626d60b3fe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:48.780410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-278b78cd-4930-4285-b3ec-eb626d60b3fe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:48.781094 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-278b78cd-4930-4285-b3ec-eb626d60b3fe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:48.782031 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-278b78cd-4930-4285-b3ec-eb626d60b3fe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:48.782627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-278b78cd-4930-4285-b3ec-eb626d60b3fe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:49.042253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:49.051930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:49.053673 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:49.055025 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-47ea2cbc-edba-4585-938f-a4e5ed2dd42f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.460095 Apr 12 16:24:49.055606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 452/906] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:48 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:24:49.065564 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-278b78cd-4930-4285-b3ec-eb626d60b3fe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:49.066939 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-278b78cd-4930-4285-b3ec-eb626d60b3fe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.305976 Apr 12 16:24:49.071450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 455/907] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:48 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:50.073064 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:50.081209 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:50.085772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-90dacf70-5c57-460e-8c1c-8e36b98fcf62 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:50.086562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-90dacf70-5c57-460e-8c1c-8e36b98fcf62 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:50.087972 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:50.088461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:50.089292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:50.089735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:50.094467 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90dacf70-5c57-460e-8c1c-8e36b98fcf62 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:50.094928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90dacf70-5c57-460e-8c1c-8e36b98fcf62 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:50.095923 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90dacf70-5c57-460e-8c1c-8e36b98fcf62 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:50.096367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90dacf70-5c57-460e-8c1c-8e36b98fcf62 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:50.287463 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:50.296151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:50.296310 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-90dacf70-5c57-460e-8c1c-8e36b98fcf62 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:50.298206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:50.299322 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1d5b51f9-d3fe-4208-9a26-ce4f1cf66d71 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.230384 Apr 12 16:24:50.299926 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 453/908] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:50 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:50.305067 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-90dacf70-5c57-460e-8c1c-8e36b98fcf62 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.224460 Apr 12 16:24:50.305631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 456/909] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:50 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:51.321435 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:51.322577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-539e0cb3-035a-4eb0-a50b-f6fa39ae2696 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:51.323213 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-539e0cb3-035a-4eb0-a50b-f6fa39ae2696 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:51.323705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:51.332832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-539e0cb3-035a-4eb0-a50b-f6fa39ae2696 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:51.333300 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-539e0cb3-035a-4eb0-a50b-f6fa39ae2696 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:51.334134 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-539e0cb3-035a-4eb0-a50b-f6fa39ae2696 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:51.336408 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:51.336800 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-539e0cb3-035a-4eb0-a50b-f6fa39ae2696 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:51.337402 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:51.339180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:51.340490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:51.892041 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:51.900370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-539e0cb3-035a-4eb0-a50b-f6fa39ae2696 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:51.900563 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:51.901964 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:51.903128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f878fe93-dfad-491f-bca3-9e53922cfb31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.589946 Apr 12 16:24:51.903699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 454/910] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:51 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:51.908296 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-539e0cb3-035a-4eb0-a50b-f6fa39ae2696 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.589847 Apr 12 16:24:51.908837 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 457/911] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:51 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:52.921601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:52.922237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:52.925167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-aacfa4c8-c949-46e8-9f8b-cff36a39a10f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:52.925864 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-aacfa4c8-c949-46e8-9f8b-cff36a39a10f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:52.928714 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:52.929208 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:52.930031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:52.930498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:52.932845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aacfa4c8-c949-46e8-9f8b-cff36a39a10f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:52.933504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aacfa4c8-c949-46e8-9f8b-cff36a39a10f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:52.934403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aacfa4c8-c949-46e8-9f8b-cff36a39a10f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:52.935135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-aacfa4c8-c949-46e8-9f8b-cff36a39a10f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:53.130574 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:53.134520 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-aacfa4c8-c949-46e8-9f8b-cff36a39a10f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:53.138959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:53.140582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:53.141768 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c50e4697-233c-44bd-b780-e3547811891a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.224168 Apr 12 16:24:53.142081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-aacfa4c8-c949-46e8-9f8b-cff36a39a10f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.220895 Apr 12 16:24:53.142397 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 455/912] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:52 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:53.142758 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 458/913] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:52 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:54.159376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cf95125c-2a3a-40fd-a12b-938fa9bfbc78 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:54.159888 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:54.160272 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-cf95125c-2a3a-40fd-a12b-938fa9bfbc78 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:54.160450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:54.166668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:54.166854 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cf95125c-2a3a-40fd-a12b-938fa9bfbc78 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:54.167117 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:54.167274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cf95125c-2a3a-40fd-a12b-938fa9bfbc78 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:54.167885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:54.168028 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cf95125c-2a3a-40fd-a12b-938fa9bfbc78 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:54.168318 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:54.168462 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cf95125c-2a3a-40fd-a12b-938fa9bfbc78 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:54.360481 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:54.363830 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-cf95125c-2a3a-40fd-a12b-938fa9bfbc78 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:54.368774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:54.370452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:54.371773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a08683a4-474e-4040-bf5f-8e7b21f678c6 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.216009 Apr 12 16:24:54.371891 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-cf95125c-2a3a-40fd-a12b-938fa9bfbc78 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.216465 Apr 12 16:24:54.372445 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 456/914] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:54 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:54.372619 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 459/915] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:54 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:54.975885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-e3d2dbe6-fdab-458c-a519-1c3562f35e6c req-6f688c27-38e9-48b6-9192-c654d2663712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79e2e80-5679-41bd-aab2-6e740d404eb7", "name": "network-vif-plugged", "status": "completed", "tag": "ea4a126a-a7f5-4e56-928d-bd76dc66e823"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:54.985142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-e3d2dbe6-fdab-458c-a519-1c3562f35e6c req-6f688c27-38e9-48b6-9192-c654d2663712 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:54.985142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-e3d2dbe6-fdab-458c-a519-1c3562f35e6c req-6f688c27-38e9-48b6-9192-c654d2663712 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:54.997514 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-e3d2dbe6-fdab-458c-a519-1c3562f35e6c req-6f688c27-38e9-48b6-9192-c654d2663712 service nova] Creating event network-vif-plugged:ea4a126a-a7f5-4e56-928d-bd76dc66e823 for instance d79e2e80-5679-41bd-aab2-6e740d404eb7 on hv-cinder-83752 Apr 12 16:24:55.003541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-e3d2dbe6-fdab-458c-a519-1c3562f35e6c req-6f688c27-38e9-48b6-9192-c654d2663712 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031481 Apr 12 16:24:55.004139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 460/916] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:24:55.389766 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5224c669-1868-495b-8b72-6d67809e4955 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:55.391047 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5224c669-1868-495b-8b72-6d67809e4955 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:55.391243 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:55.391761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:55.397699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5224c669-1868-495b-8b72-6d67809e4955 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:55.398202 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5224c669-1868-495b-8b72-6d67809e4955 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:55.398932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:55.399047 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5224c669-1868-495b-8b72-6d67809e4955 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:55.399384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:55.399496 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5224c669-1868-495b-8b72-6d67809e4955 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:55.400160 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:55.400599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:55.641275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5224c669-1868-495b-8b72-6d67809e4955 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:55.649184 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:55.649376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5224c669-1868-495b-8b72-6d67809e4955 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.263620 Apr 12 16:24:55.650126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 457/917] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:55 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:55.659724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:55.662246 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:55.663765 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7b290d6f-2d0f-4023-9a02-bfa6ee455076 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.277450 Apr 12 16:24:55.664557 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 461/918] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:55 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:56.670660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-78e618a0-314b-442a-a07d-665ab90d42f6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:56.671648 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-78e618a0-314b-442a-a07d-665ab90d42f6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:56.682350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-78e618a0-314b-442a-a07d-665ab90d42f6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:56.683100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-78e618a0-314b-442a-a07d-665ab90d42f6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:56.684451 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-78e618a0-314b-442a-a07d-665ab90d42f6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:56.685137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-78e618a0-314b-442a-a07d-665ab90d42f6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:56.685770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:56.686416 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:56.693163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:56.693821 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:56.694646 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:56.695084 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:56.888637 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-78e618a0-314b-442a-a07d-665ab90d42f6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:56.893102 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:56.896112 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-78e618a0-314b-442a-a07d-665ab90d42f6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.232185 Apr 12 16:24:56.896945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 458/919] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:56 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:56.901494 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:56.903241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:56.904360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-595a1da5-5368-417d-bdbf-acd8df26eb6e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.224613 Apr 12 16:24:56.904975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 462/920] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:56 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:24:57.915218 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b5ef0018-d574-4c83-bb8b-d7400186ccbf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:57.915828 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b5ef0018-d574-4c83-bb8b-d7400186ccbf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:57.922553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:57.923027 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b5ef0018-d574-4c83-bb8b-d7400186ccbf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:57.923114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:57.923337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b5ef0018-d574-4c83-bb8b-d7400186ccbf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:57.924115 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b5ef0018-d574-4c83-bb8b-d7400186ccbf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:57.924559 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b5ef0018-d574-4c83-bb8b-d7400186ccbf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:57.929670 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:57.930159 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:57.930934 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:57.931409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:58.120547 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b5ef0018-d574-4c83-bb8b-d7400186ccbf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:58.123570 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:58.128358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b5ef0018-d574-4c83-bb8b-d7400186ccbf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.217140 Apr 12 16:24:58.129248 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 459/921] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:57 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:58.132913 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:58.134421 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:58.135532 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5c8d4424-958d-43f0-b420-daa2e3ccfbb7 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1406 microversion: 2.20 time: 0.217340 Apr 12 16:24:58.136099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 463/922] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:57 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:58.518859 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-833226ce-fcfe-4fe0-9d8f-641c5405c66c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:58.519969 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-833226ce-fcfe-4fe0-9d8f-641c5405c66c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:58.525996 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-833226ce-fcfe-4fe0-9d8f-641c5405c66c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:58.526483 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-833226ce-fcfe-4fe0-9d8f-641c5405c66c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:58.527259 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-833226ce-fcfe-4fe0-9d8f-641c5405c66c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:58.527695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-833226ce-fcfe-4fe0-9d8f-641c5405c66c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:58.556734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-833226ce-fcfe-4fe0-9d8f-641c5405c66c tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042031 Apr 12 16:24:58.557306 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 460/923] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:24:58 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:24:58.616630 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5ce4fc49-3e5d-447b-b093-1c311da00ed2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:58.617137 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5ce4fc49-3e5d-447b-b093-1c311da00ed2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:58.625332 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5ce4fc49-3e5d-447b-b093-1c311da00ed2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:58.625796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5ce4fc49-3e5d-447b-b093-1c311da00ed2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:58.626614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5ce4fc49-3e5d-447b-b093-1c311da00ed2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:58.627054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5ce4fc49-3e5d-447b-b093-1c311da00ed2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:58.652039 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5ce4fc49-3e5d-447b-b093-1c311da00ed2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:24:58.736719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5ce4fc49-3e5d-447b-b093-1c311da00ed2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 204 len: 0 microversion: 2.1 time: 0.123520 Apr 12 16:24:58.737219 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 464/924] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:24:58 2022] DELETE /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:24:58.745889 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-65e7206d-0e36-4a85-b6cf-bc86c1d14173 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:58.746706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-65e7206d-0e36-4a85-b6cf-bc86c1d14173 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:58.753465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-65e7206d-0e36-4a85-b6cf-bc86c1d14173 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:58.753917 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-65e7206d-0e36-4a85-b6cf-bc86c1d14173 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:58.754732 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-65e7206d-0e36-4a85-b6cf-bc86c1d14173 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:58.755167 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-65e7206d-0e36-4a85-b6cf-bc86c1d14173 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:58.895609 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-65e7206d-0e36-4a85-b6cf-bc86c1d14173 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:58.906300 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-65e7206d-0e36-4a85-b6cf-bc86c1d14173 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1672 microversion: 2.1 time: 0.164145 Apr 12 16:24:58.907082 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 461/925] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:58 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:59.134660 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-64d99463-3d78-49be-afc3-d04766229042 req-81bd7ca9-c227-4ad6-b2c2-7343618e4e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842d987b-d6f3-432b-b6e5-311a36e9ba0a", "name": "network-vif-plugged", "status": "completed", "tag": "60428b9a-7b1b-43fb-8999-73bc88945670"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:59.144514 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-64d99463-3d78-49be-afc3-d04766229042 req-81bd7ca9-c227-4ad6-b2c2-7343618e4e1a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.144966 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-64d99463-3d78-49be-afc3-d04766229042 req-81bd7ca9-c227-4ad6-b2c2-7343618e4e1a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:59.148499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a7738f6b-8b54-491d-b0c0-d285596c456b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:59.149173 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a7738f6b-8b54-491d-b0c0-d285596c456b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:59.155998 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a7738f6b-8b54-491d-b0c0-d285596c456b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.156529 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a7738f6b-8b54-491d-b0c0-d285596c456b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:59.157507 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a7738f6b-8b54-491d-b0c0-d285596c456b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.158005 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a7738f6b-8b54-491d-b0c0-d285596c456b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:59.158162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-64d99463-3d78-49be-afc3-d04766229042 req-81bd7ca9-c227-4ad6-b2c2-7343618e4e1a service nova] Creating event network-vif-plugged:60428b9a-7b1b-43fb-8999-73bc88945670 for instance 842d987b-d6f3-432b-b6e5-311a36e9ba0a on hv-cinder-83752 Apr 12 16:24:59.163007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-64d99463-3d78-49be-afc3-d04766229042 req-81bd7ca9-c227-4ad6-b2c2-7343618e4e1a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032553 Apr 12 16:24:59.163927 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 465/926] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:59.169014 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:59.169712 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:59.176198 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.176649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:59.177432 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.177874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:59.354771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a7738f6b-8b54-491d-b0c0-d285596c456b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:59.362806 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a7738f6b-8b54-491d-b0c0-d285596c456b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.218574 Apr 12 16:24:59.370084 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 462/927] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:59 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:59.370274 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:59.377703 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:59.380095 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:24:59.381830 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c22e4212-837d-4f44-966d-0bac6563403b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1598 microversion: 2.20 time: 0.216570 Apr 12 16:24:59.382672 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 466/928] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:24:59 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1598 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:24:59.400953 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-07dd4b3d-feb2-467e-a7a8-a06e838a0f94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:59.401472 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-07dd4b3d-feb2-467e-a7a8-a06e838a0f94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:59.407515 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-07dd4b3d-feb2-467e-a7a8-a06e838a0f94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.407963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-07dd4b3d-feb2-467e-a7a8-a06e838a0f94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:59.408732 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-07dd4b3d-feb2-467e-a7a8-a06e838a0f94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.409168 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-07dd4b3d-feb2-467e-a7a8-a06e838a0f94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:59.487731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-07dd4b3d-feb2-467e-a7a8-a06e838a0f94 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090580 Apr 12 16:24:59.488291 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 463/929] 10.222.0.67 () {60 vars in 1315 bytes} [Tue Apr 12 16:24:59 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:24:59.923435 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-54fd9714-594d-4160-be6e-e64120b8a624 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:59.923963 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-54fd9714-594d-4160-be6e-e64120b8a624 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:24:59.930392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-54fd9714-594d-4160-be6e-e64120b8a624 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.930850 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-54fd9714-594d-4160-be6e-e64120b8a624 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:24:59.931635 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-54fd9714-594d-4160-be6e-e64120b8a624 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:24:59.932215 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-54fd9714-594d-4160-be6e-e64120b8a624 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:00.150593 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-54fd9714-594d-4160-be6e-e64120b8a624 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:00.159001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-54fd9714-594d-4160-be6e-e64120b8a624 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1672 microversion: 2.1 time: 0.239586 Apr 12 16:25:00.159663 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 467/930] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:24:59 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1672 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:00.383217 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-56710671-95a2-4872-8b3c-580bce794cd5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:00.383787 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-56710671-95a2-4872-8b3c-580bce794cd5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:00.390652 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56710671-95a2-4872-8b3c-580bce794cd5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:00.391109 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56710671-95a2-4872-8b3c-580bce794cd5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:00.391895 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56710671-95a2-4872-8b3c-580bce794cd5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:00.392333 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56710671-95a2-4872-8b3c-580bce794cd5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:00.629933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-56710671-95a2-4872-8b3c-580bce794cd5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:00.639200 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-56710671-95a2-4872-8b3c-580bce794cd5 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.260373 Apr 12 16:25:00.639841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 464/931] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:00 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:00.737581 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-a72fc779-f9c8-4cbe-b99a-6b0a668f1b68 req-33263eb8-3479-49e8-be29-6a1ec5794509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79e2e80-5679-41bd-aab2-6e740d404eb7", "tag": "ea4a126a-a7f5-4e56-928d-bd76dc66e823"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:00.745612 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-a72fc779-f9c8-4cbe-b99a-6b0a668f1b68 req-33263eb8-3479-49e8-be29-6a1ec5794509 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:00.746069 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-a72fc779-f9c8-4cbe-b99a-6b0a668f1b68 req-33263eb8-3479-49e8-be29-6a1ec5794509 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:00.757382 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-a72fc779-f9c8-4cbe-b99a-6b0a668f1b68 req-33263eb8-3479-49e8-be29-6a1ec5794509 service nova] Creating event network-changed:ea4a126a-a7f5-4e56-928d-bd76dc66e823 for instance d79e2e80-5679-41bd-aab2-6e740d404eb7 on hv-cinder-83752 Apr 12 16:25:00.762511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-a72fc779-f9c8-4cbe-b99a-6b0a668f1b68 req-33263eb8-3479-49e8-be29-6a1ec5794509 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028395 Apr 12 16:25:00.763305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 468/932] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:01.177306 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8aeac994-5a91-4c62-aeb7-c80e4ba5c66f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:01.178068 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8aeac994-5a91-4c62-aeb7-c80e4ba5c66f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:01.184225 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8aeac994-5a91-4c62-aeb7-c80e4ba5c66f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:01.184718 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8aeac994-5a91-4c62-aeb7-c80e4ba5c66f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:01.185468 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8aeac994-5a91-4c62-aeb7-c80e4ba5c66f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:01.185906 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8aeac994-5a91-4c62-aeb7-c80e4ba5c66f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:01.288619 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e1b185ee-3090-4968-8c40-5d1ca22f0322 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:01.290217 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e1b185ee-3090-4968-8c40-5d1ca22f0322 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:01.297170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e1b185ee-3090-4968-8c40-5d1ca22f0322 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:01.298194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e1b185ee-3090-4968-8c40-5d1ca22f0322 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:01.299196 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e1b185ee-3090-4968-8c40-5d1ca22f0322 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:01.299848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e1b185ee-3090-4968-8c40-5d1ca22f0322 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:01.319806 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8aeac994-5a91-4c62-aeb7-c80e4ba5c66f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:01.326452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e1b185ee-3090-4968-8c40-5d1ca22f0322 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/ips" status: 200 len: 149 microversion: 2.1 time: 0.043483 Apr 12 16:25:01.333177 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8aeac994-5a91-4c62-aeb7-c80e4ba5c66f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1672 microversion: 2.1 time: 0.155761 Apr 12 16:25:01.333177 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 465/933] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:01 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:01.333771 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 469/934] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:25:01 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:01.657990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3fde5d78-addb-40c6-a45e-2e7e1cf1df7b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:01.658769 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3fde5d78-addb-40c6-a45e-2e7e1cf1df7b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:01.665870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3fde5d78-addb-40c6-a45e-2e7e1cf1df7b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:01.666356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3fde5d78-addb-40c6-a45e-2e7e1cf1df7b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:01.667404 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3fde5d78-addb-40c6-a45e-2e7e1cf1df7b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:01.670702 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3fde5d78-addb-40c6-a45e-2e7e1cf1df7b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:01.877461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-284273d0-ecde-4323-94b4-f1e435e65e5a req-6aa77283-fe07-4b0d-b1b5-d4fee642cc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23749e20-689d-41b3-b798-49c86d90ae20", "name": "network-vif-deleted", "tag": "28e64fcd-7b2c-41c0-8cce-a7de7807a101"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:01.896292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3fde5d78-addb-40c6-a45e-2e7e1cf1df7b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:01.906443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3fde5d78-addb-40c6-a45e-2e7e1cf1df7b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1264 microversion: 2.1 time: 0.253266 Apr 12 16:25:01.916007 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 466/935] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:01 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:01.918539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-284273d0-ecde-4323-94b4-f1e435e65e5a req-6aa77283-fe07-4b0d-b1b5-d4fee642cc4f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:01.919186 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-284273d0-ecde-4323-94b4-f1e435e65e5a req-6aa77283-fe07-4b0d-b1b5-d4fee642cc4f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:01.959048 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-284273d0-ecde-4323-94b4-f1e435e65e5a req-6aa77283-fe07-4b0d-b1b5-d4fee642cc4f service nova] Creating event network-vif-deleted:28e64fcd-7b2c-41c0-8cce-a7de7807a101 for instance 23749e20-689d-41b3-b798-49c86d90ae20 on hv-cinder-83752 Apr 12 16:25:01.969395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-284273d0-ecde-4323-94b4-f1e435e65e5a req-6aa77283-fe07-4b0d-b1b5-d4fee642cc4f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101094 Apr 12 16:25:01.974143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 470/936] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:02.348233 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:02.349130 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:02.359830 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:02.360358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:02.361210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:02.361717 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:02.398781 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:02.399525 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:02.400174 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lazy-loading 'fault' on Instance uuid 23749e20-689d-41b3-b798-49c86d90ae20 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:25:02.445164 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:02.453415 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7ac86f05-5f4a-41de-b417-96b45e3b38f4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 200 len: 1327 microversion: 2.1 time: 0.109537 Apr 12 16:25:02.453974 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 467/937] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:02 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:02.685137 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a7cc26d9-a9df-4e6a-8558-db1b27552c3e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a533791-4d4b-4ed9-92e1-b95bfcad0aa2"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:02.686321 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a7cc26d9-a9df-4e6a-8558-db1b27552c3e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:02.692916 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7cc26d9-a9df-4e6a-8558-db1b27552c3e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:02.693366 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7cc26d9-a9df-4e6a-8558-db1b27552c3e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:02.694183 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7cc26d9-a9df-4e6a-8558-db1b27552c3e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:02.694626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a7cc26d9-a9df-4e6a-8558-db1b27552c3e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:02.934780 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-804d1ed9-e740-46ee-ab05-b428ff44b98d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:02.935950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-804d1ed9-e740-46ee-ab05-b428ff44b98d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:02.943153 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-804d1ed9-e740-46ee-ab05-b428ff44b98d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:02.944071 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-804d1ed9-e740-46ee-ab05-b428ff44b98d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:02.944900 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-804d1ed9-e740-46ee-ab05-b428ff44b98d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:02.945336 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-804d1ed9-e740-46ee-ab05-b428ff44b98d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:03.089471 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-804d1ed9-e740-46ee-ab05-b428ff44b98d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:03.097426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-804d1ed9-e740-46ee-ab05-b428ff44b98d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1452 microversion: 2.1 time: 0.167841 Apr 12 16:25:03.098000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 468/938] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:02 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:25:03.114692 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4590be6d-d502-4aed-a67c-49aa154a4dbe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:03.115429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4590be6d-d502-4aed-a67c-49aa154a4dbe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:03.121845 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4590be6d-d502-4aed-a67c-49aa154a4dbe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:03.122406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4590be6d-d502-4aed-a67c-49aa154a4dbe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:03.123265 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4590be6d-d502-4aed-a67c-49aa154a4dbe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:03.123775 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4590be6d-d502-4aed-a67c-49aa154a4dbe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:03.270837 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4590be6d-d502-4aed-a67c-49aa154a4dbe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:03.278691 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4590be6d-d502-4aed-a67c-49aa154a4dbe tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1452 microversion: 2.1 time: 0.168323 Apr 12 16:25:03.279268 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 469/939] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:03 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:03.470798 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:03.471858 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:03.482972 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:03.484686 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:03.485613 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:03.486528 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:03.495165 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a7cc26d9-a9df-4e6a-8558-db1b27552c3e tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814949 Apr 12 16:25:03.495857 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 471/940] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:25:02 2022] POST /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:03.507937 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] HTTP exception thrown: Instance 23749e20-689d-41b3-b798-49c86d90ae20 could not be found. Apr 12 16:25:03.508691 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Returning 404 to user: Instance 23749e20-689d-41b3-b798-49c86d90ae20 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:25:03.509689 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7da1b07a-854a-4275-aa91-ed559142fe34 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 404 len: 111 microversion: 2.1 time: 0.042853 Apr 12 16:25:03.514065 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 470/941] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:03 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:25:03.533354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-6fc00dcf-4774-4d96-a480-eab94d8812dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '.version_select at 0x7f246dbfb430>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:03.560395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-6fc00dcf-4774-4d96-a480-eab94d8812dd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216905054" status: 202 len: 0 microversion: 2.1 time: 0.043793 Apr 12 16:25:03.561420 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 472/942] 10.222.0.67 () {58 vars in 1220 bytes} [Tue Apr 12 16:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216905054 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:25:04.224921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f4d9841b-0111-45fd-b56d-6d98b6aed87f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'create', calling method: .version_select at 0x7f246db8aaf0>, body: {"keypair": {"name": "tempest-keypair-2024620547"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:04.241493 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-f4d9841b-0111-45fd-b56d-6d98b6aed87f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for project 9e274b464718459ea125ef2d5b5003ce. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:25:04.246714 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-f4d9841b-0111-45fd-b56d-6d98b6aed87f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for user adf30b4421074395b1b70e44bcf6ed10 and project 9e274b464718459ea125ef2d5b5003ce. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:25:04.860943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-f4d9841b-0111-45fd-b56d-6d98b6aed87f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for project 9e274b464718459ea125ef2d5b5003ce. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:25:04.864623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-f4d9841b-0111-45fd-b56d-6d98b6aed87f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for user adf30b4421074395b1b70e44bcf6ed10 and project 9e274b464718459ea125ef2d5b5003ce. Resources: {'key_pairs'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:25:04.877604 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f4d9841b-0111-45fd-b56d-6d98b6aed87f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.658491 Apr 12 16:25:04.878241 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 471/943] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:25:04 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:05.230446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-36814d5f-1e22-4662-b7d3-0dd8e82cd38f req-7ae0f4b4-e391-406e-aa7c-808dc6eb1a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842d987b-d6f3-432b-b6e5-311a36e9ba0a", "tag": "60428b9a-7b1b-43fb-8999-73bc88945670"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:05.240265 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-36814d5f-1e22-4662-b7d3-0dd8e82cd38f req-7ae0f4b4-e391-406e-aa7c-808dc6eb1a60 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:05.240723 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-36814d5f-1e22-4662-b7d3-0dd8e82cd38f req-7ae0f4b4-e391-406e-aa7c-808dc6eb1a60 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:05.252359 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-36814d5f-1e22-4662-b7d3-0dd8e82cd38f req-7ae0f4b4-e391-406e-aa7c-808dc6eb1a60 service nova] Creating event network-changed:60428b9a-7b1b-43fb-8999-73bc88945670 for instance 842d987b-d6f3-432b-b6e5-311a36e9ba0a on hv-cinder-83752 Apr 12 16:25:05.258348 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-36814d5f-1e22-4662-b7d3-0dd8e82cd38f req-7ae0f4b4-e391-406e-aa7c-808dc6eb1a60 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032197 Apr 12 16:25:05.263085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 473/944] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:06.262895 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-672180551", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "028a45e4-8708-408c-a3b9-d772d5389f9f"}], "security_groups": [{"name": "tempest-securitygroup--691156853"}], "key_name": "tempest-keypair-2024620547", "user_data": "}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:06.369749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] validate_networks() for [('028a45e4-8708-408c-a3b9-d772d5389f9f', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:25:06.774922 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:25:06.775344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:25:06.775841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:25:06.776252 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:25:06.776663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:25:06.788037 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:06.788483 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:06.789541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:06.789971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:06.807303 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for project 9e274b464718459ea125ef2d5b5003ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:25:06.811631 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Getting quotas for user adf30b4421074395b1b70e44bcf6ed10 and project 9e274b464718459ea125ef2d5b5003ce. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:25:06.823419 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:25:06.826100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:25:06.873437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ace03ef5-34c4-40fa-835c-ee6c46a84a72 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.615581 Apr 12 16:25:06.874095 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 472/945] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:25:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:25:06.885296 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-52d3b03d-341b-4e41-aee3-e415630cabfc tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:06.886025 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-52d3b03d-341b-4e41-aee3-e415630cabfc tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:06.943456 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-52d3b03d-341b-4e41-aee3-e415630cabfc tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:06.950645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-52d3b03d-341b-4e41-aee3-e415630cabfc tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1237 microversion: 2.1 time: 0.070232 Apr 12 16:25:06.951228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 474/946] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:06 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:07.968113 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-91412906-5362-4de8-8444-cb0cf16a44d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:07.968763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-91412906-5362-4de8-8444-cb0cf16a44d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:07.977290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-91412906-5362-4de8-8444-cb0cf16a44d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:07.977752 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-91412906-5362-4de8-8444-cb0cf16a44d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:07.978779 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-91412906-5362-4de8-8444-cb0cf16a44d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:07.979223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-91412906-5362-4de8-8444-cb0cf16a44d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:08.061777 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-91412906-5362-4de8-8444-cb0cf16a44d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:08.070293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-91412906-5362-4de8-8444-cb0cf16a44d1 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1297 microversion: 2.1 time: 0.106813 Apr 12 16:25:08.074845 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 473/947] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:07 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:09.088460 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a0942843-a96f-4971-8286-21a95b691fea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:09.089125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a0942843-a96f-4971-8286-21a95b691fea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:09.096814 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0942843-a96f-4971-8286-21a95b691fea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:09.097269 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0942843-a96f-4971-8286-21a95b691fea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:09.098146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0942843-a96f-4971-8286-21a95b691fea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:09.098614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0942843-a96f-4971-8286-21a95b691fea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:09.321710 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a0942843-a96f-4971-8286-21a95b691fea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:09.330847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a0942843-a96f-4971-8286-21a95b691fea tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.246519 Apr 12 16:25:09.332027 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 475/948] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:09 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:09.481655 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-2b7d3a8b-3436-4758-b2e5-21f4854b49b4 req-e38167c7-6894-4d25-9821-d599b6d4fe87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43555d2-47fe-4abc-9410-62d4af8a5c8d", "tag": "a14a2ded-c1a2-48f4-8a82-e95849ab2429"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:09.493183 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2b7d3a8b-3436-4758-b2e5-21f4854b49b4 req-e38167c7-6894-4d25-9821-d599b6d4fe87 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:09.493628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2b7d3a8b-3436-4758-b2e5-21f4854b49b4 req-e38167c7-6894-4d25-9821-d599b6d4fe87 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:09.509784 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-2b7d3a8b-3436-4758-b2e5-21f4854b49b4 req-e38167c7-6894-4d25-9821-d599b6d4fe87 service nova] Creating event network-changed:a14a2ded-c1a2-48f4-8a82-e95849ab2429 for instance a43555d2-47fe-4abc-9410-62d4af8a5c8d on hv-cinder-83752 Apr 12 16:25:09.515460 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-2b7d3a8b-3436-4758-b2e5-21f4854b49b4 req-e38167c7-6894-4d25-9821-d599b6d4fe87 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039553 Apr 12 16:25:09.516649 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 474/949] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:10.352177 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cb12657e-fcee-4241-8ebf-98c3c9d06658 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:10.352933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cb12657e-fcee-4241-8ebf-98c3c9d06658 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:10.362527 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cb12657e-fcee-4241-8ebf-98c3c9d06658 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:10.363319 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cb12657e-fcee-4241-8ebf-98c3c9d06658 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:10.364397 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cb12657e-fcee-4241-8ebf-98c3c9d06658 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:10.365290 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cb12657e-fcee-4241-8ebf-98c3c9d06658 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:10.575659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cb12657e-fcee-4241-8ebf-98c3c9d06658 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:10.583719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cb12657e-fcee-4241-8ebf-98c3c9d06658 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.236795 Apr 12 16:25:10.584301 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 476/950] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:10 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:11.039531 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a533791-4d4b-4ed9-92e1-b95bfcad0aa2"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:11.040675 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:11.046825 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:11.047280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:11.048056 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:11.048489 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:11.134060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Invalid volume: volume 6a533791-4d4b-4ed9-92e1-b95bfcad0aa2 is already attached to instances: ea521f02-9af9-4bc5-b265-df2e2c2c70f5 Apr 12 16:25:11.134660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 400 to user: Invalid volume: volume 6a533791-4d4b-4ed9-92e1-b95bfcad0aa2 is already attached to instances: ea521f02-9af9-4bc5-b265-df2e2c2c70f5 {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:25:11.135499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d81e5cc4-4b1f-4373-8d58-f3466a6c4324 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100915 Apr 12 16:25:11.136065 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 475/951] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:25:11 2022] POST /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:25:11.194344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-97cd8b0e-7eff-4729-b12e-cfad432a293d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:11.194838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-97cd8b0e-7eff-4729-b12e-cfad432a293d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:11.201343 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-97cd8b0e-7eff-4729-b12e-cfad432a293d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:11.201797 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-97cd8b0e-7eff-4729-b12e-cfad432a293d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:11.203418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-97cd8b0e-7eff-4729-b12e-cfad432a293d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:11.204167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-97cd8b0e-7eff-4729-b12e-cfad432a293d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:11.291924 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-97cd8b0e-7eff-4729-b12e-cfad432a293d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'services' on Instance uuid ea521f02-9af9-4bc5-b265-df2e2c2c70f5 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:25:11.371121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-97cd8b0e-7eff-4729-b12e-cfad432a293d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments/6a533791-4d4b-4ed9-92e1-b95bfcad0aa2" status: 202 len: 0 microversion: 2.1 time: 0.179929 Apr 12 16:25:11.372018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 477/952] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:25:11 2022] DELETE /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments/6a533791-4d4b-4ed9-92e1-b95bfcad0aa2 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:25:11.383927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8b9fdaab-80d9-4e23-aee9-0c72f4b2a2a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:11.384857 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8b9fdaab-80d9-4e23-aee9-0c72f4b2a2a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:11.391214 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8b9fdaab-80d9-4e23-aee9-0c72f4b2a2a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:11.391806 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8b9fdaab-80d9-4e23-aee9-0c72f4b2a2a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:11.392582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8b9fdaab-80d9-4e23-aee9-0c72f4b2a2a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:11.393051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8b9fdaab-80d9-4e23-aee9-0c72f4b2a2a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:11.422566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8b9fdaab-80d9-4e23-aee9-0c72f4b2a2a8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042631 Apr 12 16:25:11.423123 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 476/953] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:25:11 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:11.606192 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3cd884b9-f1d4-469f-8f52-a85ac6a737d2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:11.607334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3cd884b9-f1d4-469f-8f52-a85ac6a737d2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:11.617954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cd884b9-f1d4-469f-8f52-a85ac6a737d2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:11.618749 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cd884b9-f1d4-469f-8f52-a85ac6a737d2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:11.620015 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cd884b9-f1d4-469f-8f52-a85ac6a737d2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:11.620808 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3cd884b9-f1d4-469f-8f52-a85ac6a737d2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:11.758425 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3cd884b9-f1d4-469f-8f52-a85ac6a737d2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:11.766227 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3cd884b9-f1d4-469f-8f52-a85ac6a737d2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.167458 Apr 12 16:25:11.766828 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 478/954] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:11 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:12.438372 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7803a1e9-d8f2-4224-864b-64f456220d13 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:12.439499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7803a1e9-d8f2-4224-864b-64f456220d13 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:12.448253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7803a1e9-d8f2-4224-864b-64f456220d13 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:12.449699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7803a1e9-d8f2-4224-864b-64f456220d13 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:12.450785 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7803a1e9-d8f2-4224-864b-64f456220d13 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:12.451488 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7803a1e9-d8f2-4224-864b-64f456220d13 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:12.485307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7803a1e9-d8f2-4224-864b-64f456220d13 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053130 Apr 12 16:25:12.485853 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 477/955] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:25:12 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:12.792034 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-918a4e02-8a7f-4971-9755-f5f57a62592e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:12.793081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-918a4e02-8a7f-4971-9755-f5f57a62592e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:12.800214 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-918a4e02-8a7f-4971-9755-f5f57a62592e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:12.800670 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-918a4e02-8a7f-4971-9755-f5f57a62592e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:12.801487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-918a4e02-8a7f-4971-9755-f5f57a62592e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:12.801926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-918a4e02-8a7f-4971-9755-f5f57a62592e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:12.940067 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-918a4e02-8a7f-4971-9755-f5f57a62592e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:12.951072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-918a4e02-8a7f-4971-9755-f5f57a62592e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.166157 Apr 12 16:25:12.951641 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 479/956] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:12 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:13.499100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6243cf4d-e7bc-4557-b78f-fb90f1749d4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:13.500107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6243cf4d-e7bc-4557-b78f-fb90f1749d4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:13.509635 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6243cf4d-e7bc-4557-b78f-fb90f1749d4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:13.510319 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6243cf4d-e7bc-4557-b78f-fb90f1749d4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:13.511524 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6243cf4d-e7bc-4557-b78f-fb90f1749d4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:13.511958 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6243cf4d-e7bc-4557-b78f-fb90f1749d4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:13.541875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6243cf4d-e7bc-4557-b78f-fb90f1749d4c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048587 Apr 12 16:25:13.542501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 478/957] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:25:13 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:13.969906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-91ff0b7c-0303-4153-ac05-0eeb2b530f95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:13.970566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-91ff0b7c-0303-4153-ac05-0eeb2b530f95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:13.977614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91ff0b7c-0303-4153-ac05-0eeb2b530f95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:13.978080 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91ff0b7c-0303-4153-ac05-0eeb2b530f95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:13.978928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91ff0b7c-0303-4153-ac05-0eeb2b530f95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:13.979391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91ff0b7c-0303-4153-ac05-0eeb2b530f95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:14.114504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-91ff0b7c-0303-4153-ac05-0eeb2b530f95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:14.122325 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-91ff0b7c-0303-4153-ac05-0eeb2b530f95 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.156528 Apr 12 16:25:14.122893 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 480/958] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:13 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:14.553382 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d6a199f0-4e48-4dea-838e-c9e41244b126 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:14.554443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d6a199f0-4e48-4dea-838e-c9e41244b126 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:14.561522 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d6a199f0-4e48-4dea-838e-c9e41244b126 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:14.561997 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d6a199f0-4e48-4dea-838e-c9e41244b126 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:14.562829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d6a199f0-4e48-4dea-838e-c9e41244b126 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:14.563293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d6a199f0-4e48-4dea-838e-c9e41244b126 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:14.594133 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d6a199f0-4e48-4dea-838e-c9e41244b126 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044855 Apr 12 16:25:14.594677 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 479/959] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:25:14 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:25:14.660998 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-865940ab-1ca5-4d69-8acc-055d68001e17 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:14.661806 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-865940ab-1ca5-4d69-8acc-055d68001e17 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:14.669677 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-865940ab-1ca5-4d69-8acc-055d68001e17 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:14.670239 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-865940ab-1ca5-4d69-8acc-055d68001e17 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:14.671021 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-865940ab-1ca5-4d69-8acc-055d68001e17 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:14.671472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-865940ab-1ca5-4d69-8acc-055d68001e17 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:14.696682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-865940ab-1ca5-4d69-8acc-055d68001e17 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:25:14.779782 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-865940ab-1ca5-4d69-8acc-055d68001e17 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 204 len: 0 microversion: 2.1 time: 0.124761 Apr 12 16:25:14.780334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 481/960] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:25:14 2022] DELETE /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:25:14.789538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bbf9e699-3f6d-4a7a-bb7f-1b99b303eee6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:14.790196 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bbf9e699-3f6d-4a7a-bb7f-1b99b303eee6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:14.796640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bbf9e699-3f6d-4a7a-bb7f-1b99b303eee6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:14.797117 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bbf9e699-3f6d-4a7a-bb7f-1b99b303eee6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:14.797934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bbf9e699-3f6d-4a7a-bb7f-1b99b303eee6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:14.798471 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bbf9e699-3f6d-4a7a-bb7f-1b99b303eee6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:14.949779 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-bbf9e699-3f6d-4a7a-bb7f-1b99b303eee6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:14.957615 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bbf9e699-3f6d-4a7a-bb7f-1b99b303eee6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1681 microversion: 2.1 time: 0.172284 Apr 12 16:25:14.958227 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 480/961] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:14 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:15.140402 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-fdd5c264-077f-4d11-bbe1-eccc2114acda tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:15.141228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-fdd5c264-077f-4d11-bbe1-eccc2114acda tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:15.148004 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fdd5c264-077f-4d11-bbe1-eccc2114acda tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:15.148454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fdd5c264-077f-4d11-bbe1-eccc2114acda tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:15.149220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fdd5c264-077f-4d11-bbe1-eccc2114acda tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:15.149653 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fdd5c264-077f-4d11-bbe1-eccc2114acda tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:15.285645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-fdd5c264-077f-4d11-bbe1-eccc2114acda tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:15.293413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-fdd5c264-077f-4d11-bbe1-eccc2114acda tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.157959 Apr 12 16:25:15.302713 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 482/962] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:15 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:15.979357 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b56c6b46-91ce-48b1-a589-fd6b1a3e81c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:15.980335 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b56c6b46-91ce-48b1-a589-fd6b1a3e81c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:15.987143 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b56c6b46-91ce-48b1-a589-fd6b1a3e81c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:15.987594 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b56c6b46-91ce-48b1-a589-fd6b1a3e81c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:15.988347 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b56c6b46-91ce-48b1-a589-fd6b1a3e81c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:15.988772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b56c6b46-91ce-48b1-a589-fd6b1a3e81c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:16.135232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b56c6b46-91ce-48b1-a589-fd6b1a3e81c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:16.143004 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b56c6b46-91ce-48b1-a589-fd6b1a3e81c2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1681 microversion: 2.1 time: 0.170209 Apr 12 16:25:16.143568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 481/963] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:15 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:16.311659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8e1cbeae-0616-450c-8aed-af03bb280607 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:16.312286 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8e1cbeae-0616-450c-8aed-af03bb280607 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:16.320629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8e1cbeae-0616-450c-8aed-af03bb280607 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:16.321565 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8e1cbeae-0616-450c-8aed-af03bb280607 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:16.322624 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8e1cbeae-0616-450c-8aed-af03bb280607 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:16.323172 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8e1cbeae-0616-450c-8aed-af03bb280607 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:16.469651 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8e1cbeae-0616-450c-8aed-af03bb280607 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:16.482533 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8e1cbeae-0616-450c-8aed-af03bb280607 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.175418 Apr 12 16:25:16.483557 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 483/964] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:16 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:17.160842 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-94a471eb-37f2-498c-8fc6-1ecfcf93b375 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:17.161417 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-94a471eb-37f2-498c-8fc6-1ecfcf93b375 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:17.169606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-94a471eb-37f2-498c-8fc6-1ecfcf93b375 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:17.170076 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-94a471eb-37f2-498c-8fc6-1ecfcf93b375 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:17.171038 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-94a471eb-37f2-498c-8fc6-1ecfcf93b375 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:17.171474 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-94a471eb-37f2-498c-8fc6-1ecfcf93b375 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:17.293535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-c0749c0d-a625-4bde-b0c5-e28ca46cfd4b req-f4618308-b49a-4098-b7a6-4ca401032dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43555d2-47fe-4abc-9410-62d4af8a5c8d", "name": "network-vif-plugged", "status": "completed", "tag": "a14a2ded-c1a2-48f4-8a82-e95849ab2429"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:17.302967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-c0749c0d-a625-4bde-b0c5-e28ca46cfd4b req-f4618308-b49a-4098-b7a6-4ca401032dea service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:17.303480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-c0749c0d-a625-4bde-b0c5-e28ca46cfd4b req-f4618308-b49a-4098-b7a6-4ca401032dea service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:17.311710 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-94a471eb-37f2-498c-8fc6-1ecfcf93b375 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:17.318080 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-c0749c0d-a625-4bde-b0c5-e28ca46cfd4b req-f4618308-b49a-4098-b7a6-4ca401032dea service nova] Creating event network-vif-plugged:a14a2ded-c1a2-48f4-8a82-e95849ab2429 for instance a43555d2-47fe-4abc-9410-62d4af8a5c8d on hv-cinder-83752 Apr 12 16:25:17.320047 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-94a471eb-37f2-498c-8fc6-1ecfcf93b375 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1681 microversion: 2.1 time: 0.163166 Apr 12 16:25:17.330350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 482/965] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:17 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:17.330849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-c0749c0d-a625-4bde-b0c5-e28ca46cfd4b req-f4618308-b49a-4098-b7a6-4ca401032dea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Apr 12 16:25:17.330849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 484/966] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:25:17.500111 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c1493bac-b163-40fb-b10c-6ad56e46c7e4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:17.500800 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c1493bac-b163-40fb-b10c-6ad56e46c7e4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:17.507533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c1493bac-b163-40fb-b10c-6ad56e46c7e4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:17.507996 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c1493bac-b163-40fb-b10c-6ad56e46c7e4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:17.508782 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c1493bac-b163-40fb-b10c-6ad56e46c7e4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:17.509223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c1493bac-b163-40fb-b10c-6ad56e46c7e4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:17.725224 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c1493bac-b163-40fb-b10c-6ad56e46c7e4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:17.733151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c1493bac-b163-40fb-b10c-6ad56e46c7e4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.236946 Apr 12 16:25:17.733716 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 483/967] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:17 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:18.338537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eed29af5-e853-495d-aef4-b52750e1bbeb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:18.339341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-eed29af5-e853-495d-aef4-b52750e1bbeb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:18.346845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eed29af5-e853-495d-aef4-b52750e1bbeb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:18.347348 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eed29af5-e853-495d-aef4-b52750e1bbeb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:18.348344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eed29af5-e853-495d-aef4-b52750e1bbeb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:18.348876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eed29af5-e853-495d-aef4-b52750e1bbeb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:18.448428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-eed29af5-e853-495d-aef4-b52750e1bbeb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:18.448720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-18d1a848-e993-46ac-974e-50513a59a0bf req-f6b7e22e-cc9a-4e67-91a2-519863d8dbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea521f02-9af9-4bc5-b265-df2e2c2c70f5", "name": "network-vif-deleted", "tag": "1812f159-e716-45a8-ad5e-89979163b257"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:18.458135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-eed29af5-e853-495d-aef4-b52750e1bbeb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1614 microversion: 2.1 time: 0.124265 Apr 12 16:25:18.468260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-18d1a848-e993-46ac-974e-50513a59a0bf req-f6b7e22e-cc9a-4e67-91a2-519863d8dbaf service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:18.468600 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 485/968] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:18 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1614 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:18.468706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-18d1a848-e993-46ac-974e-50513a59a0bf req-f6b7e22e-cc9a-4e67-91a2-519863d8dbaf service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:18.472659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-18d1a848-e993-46ac-974e-50513a59a0bf req-f6b7e22e-cc9a-4e67-91a2-519863d8dbaf service nova] Creating event network-vif-deleted:1812f159-e716-45a8-ad5e-89979163b257 for instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 on hv-cinder-83752 Apr 12 16:25:18.478192 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-18d1a848-e993-46ac-974e-50513a59a0bf req-f6b7e22e-cc9a-4e67-91a2-519863d8dbaf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034155 Apr 12 16:25:18.478808 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 484/969] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:18.751264 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-07e71015-82bc-49fc-a39c-291aea01313f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:18.751814 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-07e71015-82bc-49fc-a39c-291aea01313f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:18.757948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07e71015-82bc-49fc-a39c-291aea01313f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:18.758443 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07e71015-82bc-49fc-a39c-291aea01313f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:18.759208 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07e71015-82bc-49fc-a39c-291aea01313f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:18.759635 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07e71015-82bc-49fc-a39c-291aea01313f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:18.894643 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-07e71015-82bc-49fc-a39c-291aea01313f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:18.902681 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-07e71015-82bc-49fc-a39c-291aea01313f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1362 microversion: 2.1 time: 0.155504 Apr 12 16:25:18.903342 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 486/970] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:18 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:19.477085 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:19.477778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:19.484827 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:19.485274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:19.486056 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:19.486501 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:19.518491 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:19.518939 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:19.519395 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'fault' on Instance uuid ea521f02-9af9-4bc5-b265-df2e2c2c70f5 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:25:19.560788 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:19.568923 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7ec874fb-aa7f-4b8b-a339-b16bf3be84ea tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 200 len: 1332 microversion: 2.1 time: 0.096543 Apr 12 16:25:19.569584 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 485/971] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:19 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:19.925025 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-41b0649b-14bc-4f7b-ab2e-41afd32dee97 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:19.925904 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-41b0649b-14bc-4f7b-ab2e-41afd32dee97 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:19.935781 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-41b0649b-14bc-4f7b-ab2e-41afd32dee97 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:19.936297 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-41b0649b-14bc-4f7b-ab2e-41afd32dee97 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:19.937118 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-41b0649b-14bc-4f7b-ab2e-41afd32dee97 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:19.937585 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-41b0649b-14bc-4f7b-ab2e-41afd32dee97 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:20.071279 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-41b0649b-14bc-4f7b-ab2e-41afd32dee97 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:20.083986 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-41b0649b-14bc-4f7b-ab2e-41afd32dee97 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1549 microversion: 2.1 time: 0.165694 Apr 12 16:25:20.084775 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 487/972] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:19 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:20.102351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7d4d5c82-96e0-4a8f-b851-c1c317317e41 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:20.102840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7d4d5c82-96e0-4a8f-b851-c1c317317e41 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:20.109465 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7d4d5c82-96e0-4a8f-b851-c1c317317e41 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:20.109950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7d4d5c82-96e0-4a8f-b851-c1c317317e41 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:20.110766 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7d4d5c82-96e0-4a8f-b851-c1c317317e41 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:20.111205 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7d4d5c82-96e0-4a8f-b851-c1c317317e41 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:20.189019 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7d4d5c82-96e0-4a8f-b851-c1c317317e41 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090580 Apr 12 16:25:20.189674 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 486/973] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Apr 12 16:25:20 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:20.587303 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:20.588006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:20.594645 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:20.595097 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:20.595880 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:20.596321 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:20.610080 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 could not be found. Apr 12 16:25:20.610690 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:25:20.611531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-29b486ea-63f8-484d-9026-1818bc828ee2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 404 len: 111 microversion: 2.1 time: 0.028276 Apr 12 16:25:20.612443 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 488/974] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:20 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:25:20.621070 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ccc0fba8-4d0d-41e8-9ae2-15b24b741bd6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '.version_select at 0x7f246da46d30>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:20.640035 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ccc0fba8-4d0d-41e8-9ae2-15b24b741bd6 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422773554" status: 202 len: 0 microversion: 2.1 time: 0.023198 Apr 12 16:25:20.643941 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 487/975] 10.222.0.67 () {58 vars in 1220 bytes} [Tue Apr 12 16:25:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422773554 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:25:21.275726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5464d504-d902-4632-9e34-8ce9e0ada6e9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: .version_select at 0x7f246dbe4820>, body: {"keypair": {"name": "tempest-keypair-1613301615"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:21.290886 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-5464d504-d902-4632-9e34-8ce9e0ada6e9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:25:21.295286 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-5464d504-d902-4632-9e34-8ce9e0ada6e9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:25:21.504768 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-1c6c2cf2-6355-45ad-9a06-1d925fd39914 req-2162f0f9-b4c6-4ef4-ade5-857c064ff03f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43555d2-47fe-4abc-9410-62d4af8a5c8d", "tag": "a14a2ded-c1a2-48f4-8a82-e95849ab2429"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:21.514058 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-1c6c2cf2-6355-45ad-9a06-1d925fd39914 req-2162f0f9-b4c6-4ef4-ade5-857c064ff03f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:21.514606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-1c6c2cf2-6355-45ad-9a06-1d925fd39914 req-2162f0f9-b4c6-4ef4-ade5-857c064ff03f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:21.519855 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-5464d504-d902-4632-9e34-8ce9e0ada6e9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:25:21.523605 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-5464d504-d902-4632-9e34-8ce9e0ada6e9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:25:21.525296 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-1c6c2cf2-6355-45ad-9a06-1d925fd39914 req-2162f0f9-b4c6-4ef4-ade5-857c064ff03f service nova] Creating event network-changed:a14a2ded-c1a2-48f4-8a82-e95849ab2429 for instance a43555d2-47fe-4abc-9410-62d4af8a5c8d on hv-cinder-83752 Apr 12 16:25:21.530552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-1c6c2cf2-6355-45ad-9a06-1d925fd39914 req-2162f0f9-b4c6-4ef4-ade5-857c064ff03f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030038 Apr 12 16:25:21.531978 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 488/976] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:21.538977 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5464d504-d902-4632-9e34-8ce9e0ada6e9 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.267375 Apr 12 16:25:21.539566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 489/977] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:25:21 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:23.127874 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-954266972", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ecce0ebb-6f6d-41f3-91d1-6cb5caa3527a"}], "security_groups": [{"name": "tempest-securitygroup--862828946"}], "key_name": "tempest-keypair-1613301615", "user_data": "}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:23.230206 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] validate_networks() for [('ecce0ebb-6f6d-41f3-91d1-6cb5caa3527a', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:25:23.647676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:25:23.648301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:25:23.649021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:25:23.649632 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:25:23.650263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:25:23.659471 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:23.659919 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:23.660738 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:23.661152 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:23.678067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:25:23.682225 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Getting quotas for user f3db5fc25c5c4478942b471832aff455 and project 8743d75ee3b14874a47f8c5c5054795c. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:25:23.693639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:25:23.695995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:25:23.742791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7f6fb92d-80af-426d-9359-9fd3aa993152 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.619888 Apr 12 16:25:23.743597 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 489/978] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:25:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:25:23.754946 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-42aee55f-4e69-4099-98d2-bfa507545f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:23.755590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-42aee55f-4e69-4099-98d2-bfa507545f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:23.807720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-42aee55f-4e69-4099-98d2-bfa507545f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:23.816597 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-42aee55f-4e69-4099-98d2-bfa507545f9f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1241 microversion: 2.1 time: 0.066177 Apr 12 16:25:23.817247 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 490/979] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:23 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:24.841640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0ee41f10-eca4-47b6-947a-17ed56914c25 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:24.842889 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0ee41f10-eca4-47b6-947a-17ed56914c25 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:24.856218 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0ee41f10-eca4-47b6-947a-17ed56914c25 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:24.856662 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0ee41f10-eca4-47b6-947a-17ed56914c25 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:24.857976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0ee41f10-eca4-47b6-947a-17ed56914c25 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:24.858552 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0ee41f10-eca4-47b6-947a-17ed56914c25 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:24.929357 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0ee41f10-eca4-47b6-947a-17ed56914c25 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:24.938339 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0ee41f10-eca4-47b6-947a-17ed56914c25 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1293 microversion: 2.1 time: 0.103395 Apr 12 16:25:24.938913 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 490/980] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:24 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:25.956622 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bd4f938d-0352-4fdf-b1d4-aef05fcdcb68 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:25.957191 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bd4f938d-0352-4fdf-b1d4-aef05fcdcb68 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:25.964488 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd4f938d-0352-4fdf-b1d4-aef05fcdcb68 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:25.965079 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd4f938d-0352-4fdf-b1d4-aef05fcdcb68 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:25.966070 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd4f938d-0352-4fdf-b1d4-aef05fcdcb68 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:25.966511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd4f938d-0352-4fdf-b1d4-aef05fcdcb68 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:26.164758 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bd4f938d-0352-4fdf-b1d4-aef05fcdcb68 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:26.172798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bd4f938d-0352-4fdf-b1d4-aef05fcdcb68 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.220347 Apr 12 16:25:26.173409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 491/981] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:25 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:26.475892 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-192e99a1-73f8-4a8e-b0e1-3e508505c17e req-b50d2562-780f-4d22-8086-507a6fb3677b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205dea4d-f2a0-4140-a709-7fdf56fed565", "tag": "ad05cf0d-1109-4515-833c-5a8094f69c9d"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:26.484877 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-192e99a1-73f8-4a8e-b0e1-3e508505c17e req-b50d2562-780f-4d22-8086-507a6fb3677b service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:26.485467 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-192e99a1-73f8-4a8e-b0e1-3e508505c17e req-b50d2562-780f-4d22-8086-507a6fb3677b service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:26.512411 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-192e99a1-73f8-4a8e-b0e1-3e508505c17e req-b50d2562-780f-4d22-8086-507a6fb3677b service nova] Creating event network-changed:ad05cf0d-1109-4515-833c-5a8094f69c9d for instance 205dea4d-f2a0-4140-a709-7fdf56fed565 on hv-cinder-83752 Apr 12 16:25:26.519479 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-192e99a1-73f8-4a8e-b0e1-3e508505c17e req-b50d2562-780f-4d22-8086-507a6fb3677b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048749 Apr 12 16:25:26.520085 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 491/982] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:25:27.193204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1b4acef5-f76d-43eb-bab6-a0e17aaa6f3b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:27.193942 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-1b4acef5-f76d-43eb-bab6-a0e17aaa6f3b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:27.203182 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b4acef5-f76d-43eb-bab6-a0e17aaa6f3b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:27.203637 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b4acef5-f76d-43eb-bab6-a0e17aaa6f3b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:27.204420 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b4acef5-f76d-43eb-bab6-a0e17aaa6f3b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:27.204860 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-1b4acef5-f76d-43eb-bab6-a0e17aaa6f3b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:27.365903 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-1b4acef5-f76d-43eb-bab6-a0e17aaa6f3b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:27.374192 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1b4acef5-f76d-43eb-bab6-a0e17aaa6f3b tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.187397 Apr 12 16:25:27.374769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 492/983] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:27 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:28.396829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-aa2ec6d9-6933-438a-bf55-ed3db0de3002 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:28.397837 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-aa2ec6d9-6933-438a-bf55-ed3db0de3002 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:28.406907 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6d9-6933-438a-bf55-ed3db0de3002 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:28.407351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6d9-6933-438a-bf55-ed3db0de3002 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:28.408210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6d9-6933-438a-bf55-ed3db0de3002 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:28.408672 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6d9-6933-438a-bf55-ed3db0de3002 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:28.557613 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-aa2ec6d9-6933-438a-bf55-ed3db0de3002 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:28.569412 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-aa2ec6d9-6933-438a-bf55-ed3db0de3002 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.180093 Apr 12 16:25:28.570250 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 492/984] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:28 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:29.593516 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-273b2c4a-e389-471e-93d4-d0947ee83402 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:29.594156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-273b2c4a-e389-471e-93d4-d0947ee83402 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:29.601690 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-273b2c4a-e389-471e-93d4-d0947ee83402 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:29.602199 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-273b2c4a-e389-471e-93d4-d0947ee83402 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:29.603525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-273b2c4a-e389-471e-93d4-d0947ee83402 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:29.604072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-273b2c4a-e389-471e-93d4-d0947ee83402 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:29.834343 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-273b2c4a-e389-471e-93d4-d0947ee83402 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:29.842323 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-273b2c4a-e389-471e-93d4-d0947ee83402 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.254150 Apr 12 16:25:29.842916 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 493/985] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:29 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:30.860843 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ffc2b564-4af9-4ce4-9697-5bada179df52 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:30.861451 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ffc2b564-4af9-4ce4-9697-5bada179df52 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:30.868903 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ffc2b564-4af9-4ce4-9697-5bada179df52 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:30.869356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ffc2b564-4af9-4ce4-9697-5bada179df52 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:30.870211 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ffc2b564-4af9-4ce4-9697-5bada179df52 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:30.870736 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ffc2b564-4af9-4ce4-9697-5bada179df52 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:31.005554 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ffc2b564-4af9-4ce4-9697-5bada179df52 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:31.014654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ffc2b564-4af9-4ce4-9697-5bada179df52 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.158198 Apr 12 16:25:31.015271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 493/986] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:30 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:32.031515 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0a28c4cc-c5dc-4ee0-bd35-7a674479b4ae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:32.032229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0a28c4cc-c5dc-4ee0-bd35-7a674479b4ae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:32.038926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a28c4cc-c5dc-4ee0-bd35-7a674479b4ae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:32.039410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a28c4cc-c5dc-4ee0-bd35-7a674479b4ae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:32.040341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a28c4cc-c5dc-4ee0-bd35-7a674479b4ae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:32.040775 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a28c4cc-c5dc-4ee0-bd35-7a674479b4ae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:32.173418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0a28c4cc-c5dc-4ee0-bd35-7a674479b4ae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:32.184254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0a28c4cc-c5dc-4ee0-bd35-7a674479b4ae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.157086 Apr 12 16:25:32.184868 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 494/987] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:32 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:33.201678 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c9edfc53-2486-42ed-8b31-49589ebda88d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:33.202329 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c9edfc53-2486-42ed-8b31-49589ebda88d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:33.209727 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c9edfc53-2486-42ed-8b31-49589ebda88d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:33.210418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c9edfc53-2486-42ed-8b31-49589ebda88d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:33.211543 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c9edfc53-2486-42ed-8b31-49589ebda88d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:33.212018 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c9edfc53-2486-42ed-8b31-49589ebda88d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:33.354273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c9edfc53-2486-42ed-8b31-49589ebda88d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:33.366504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c9edfc53-2486-42ed-8b31-49589ebda88d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.169279 Apr 12 16:25:33.367098 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 494/988] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:33 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:33.390332 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-dd4fb91f-4239-4f41-92b1-611b7ab81baf req-a6752a57-3e25-482b-b090-f395be39591a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205dea4d-f2a0-4140-a709-7fdf56fed565", "name": "network-vif-plugged", "status": "completed", "tag": "ad05cf0d-1109-4515-833c-5a8094f69c9d"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:33.398955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-dd4fb91f-4239-4f41-92b1-611b7ab81baf req-a6752a57-3e25-482b-b090-f395be39591a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:33.399486 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-dd4fb91f-4239-4f41-92b1-611b7ab81baf req-a6752a57-3e25-482b-b090-f395be39591a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:33.412350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-dd4fb91f-4239-4f41-92b1-611b7ab81baf req-a6752a57-3e25-482b-b090-f395be39591a service nova] Creating event network-vif-plugged:ad05cf0d-1109-4515-833c-5a8094f69c9d for instance 205dea4d-f2a0-4140-a709-7fdf56fed565 on hv-cinder-83752 Apr 12 16:25:33.417730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-dd4fb91f-4239-4f41-92b1-611b7ab81baf req-a6752a57-3e25-482b-b090-f395be39591a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031275 Apr 12 16:25:33.418771 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 495/989] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:34.386164 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-09cab5f2-fcd2-42e1-9211-a68cbd7b83ed tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:34.386998 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-09cab5f2-fcd2-42e1-9211-a68cbd7b83ed tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:34.396622 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-09cab5f2-fcd2-42e1-9211-a68cbd7b83ed tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:34.397108 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-09cab5f2-fcd2-42e1-9211-a68cbd7b83ed tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:34.397930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-09cab5f2-fcd2-42e1-9211-a68cbd7b83ed tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:34.398426 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-09cab5f2-fcd2-42e1-9211-a68cbd7b83ed tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:34.537992 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-09cab5f2-fcd2-42e1-9211-a68cbd7b83ed tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:34.546464 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-09cab5f2-fcd2-42e1-9211-a68cbd7b83ed tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.166667 Apr 12 16:25:34.547044 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 495/990] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:34 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:35.564498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-68855998-ee92-4b23-8004-c4a2021d7936 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:35.565187 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-68855998-ee92-4b23-8004-c4a2021d7936 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:35.572045 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68855998-ee92-4b23-8004-c4a2021d7936 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:35.572509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68855998-ee92-4b23-8004-c4a2021d7936 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:35.573331 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68855998-ee92-4b23-8004-c4a2021d7936 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:35.573797 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-68855998-ee92-4b23-8004-c4a2021d7936 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:35.709068 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-68855998-ee92-4b23-8004-c4a2021d7936 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:35.718585 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-68855998-ee92-4b23-8004-c4a2021d7936 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1366 microversion: 2.1 time: 0.158288 Apr 12 16:25:35.719194 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 496/991] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:35 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:36.738017 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8aaaa077-27c5-4d98-bd7c-84ac2cea0571 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:36.738754 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8aaaa077-27c5-4d98-bd7c-84ac2cea0571 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:36.747570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8aaaa077-27c5-4d98-bd7c-84ac2cea0571 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:36.748185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8aaaa077-27c5-4d98-bd7c-84ac2cea0571 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:36.749158 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8aaaa077-27c5-4d98-bd7c-84ac2cea0571 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:36.749710 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8aaaa077-27c5-4d98-bd7c-84ac2cea0571 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:36.898648 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8aaaa077-27c5-4d98-bd7c-84ac2cea0571 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:36.910069 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8aaaa077-27c5-4d98-bd7c-84ac2cea0571 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1556 microversion: 2.1 time: 0.177022 Apr 12 16:25:36.910995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 496/992] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:36 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:36.929006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eb0c2f22-1d5c-4cef-bfab-50e46ca7bf8c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:36.929513 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-eb0c2f22-1d5c-4cef-bfab-50e46ca7bf8c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:36.936338 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb0c2f22-1d5c-4cef-bfab-50e46ca7bf8c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:36.936797 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb0c2f22-1d5c-4cef-bfab-50e46ca7bf8c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:36.937573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb0c2f22-1d5c-4cef-bfab-50e46ca7bf8c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:36.938053 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eb0c2f22-1d5c-4cef-bfab-50e46ca7bf8c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:37.021571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-eb0c2f22-1d5c-4cef-bfab-50e46ca7bf8c tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096166 Apr 12 16:25:37.022249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 497/993] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Apr 12 16:25:36 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:38.334094 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-b7b981e7-d2c4-42df-8831-6efb300c9ae6 req-afe12694-2acb-42c2-acb4-ab1897069b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205dea4d-f2a0-4140-a709-7fdf56fed565", "tag": "ad05cf0d-1109-4515-833c-5a8094f69c9d"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:38.342150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-b7b981e7-d2c4-42df-8831-6efb300c9ae6 req-afe12694-2acb-42c2-acb4-ab1897069b0e service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:38.342601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-b7b981e7-d2c4-42df-8831-6efb300c9ae6 req-afe12694-2acb-42c2-acb4-ab1897069b0e service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:38.354314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-b7b981e7-d2c4-42df-8831-6efb300c9ae6 req-afe12694-2acb-42c2-acb4-ab1897069b0e service nova] Creating event network-changed:ad05cf0d-1109-4515-833c-5a8094f69c9d for instance 205dea4d-f2a0-4140-a709-7fdf56fed565 on hv-cinder-83752 Apr 12 16:25:38.359630 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-b7b981e7-d2c4-42df-8831-6efb300c9ae6 req-afe12694-2acb-42c2-acb4-ab1897069b0e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029289 Apr 12 16:25:38.360350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 497/994] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:44.448213 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-90b60679-26e1-4700-9e04-5070afb18af0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:44.448815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-90b60679-26e1-4700-9e04-5070afb18af0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:44.455575 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90b60679-26e1-4700-9e04-5070afb18af0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:44.457571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90b60679-26e1-4700-9e04-5070afb18af0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:44.457571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90b60679-26e1-4700-9e04-5070afb18af0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:44.457571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-90b60679-26e1-4700-9e04-5070afb18af0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:44.536286 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-90b60679-26e1-4700-9e04-5070afb18af0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lazy-loading 'services' on Instance uuid b37fad20-9d1f-4785-ac0d-9babf6466375 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:25:44.612170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-90b60679-26e1-4700-9e04-5070afb18af0 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments/8c871263-1ea2-49f7-836f-b517510ed74f" status: 202 len: 0 microversion: 2.1 time: 0.169010 Apr 12 16:25:44.612758 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 498/995] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:25:44 2022] DELETE /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments/8c871263-1ea2-49f7-836f-b517510ed74f => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:25:44.621891 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bfa1f9a4-41ac-42d0-bf9f-af17b4b5ecaa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:44.622977 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bfa1f9a4-41ac-42d0-bf9f-af17b4b5ecaa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:44.629763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bfa1f9a4-41ac-42d0-bf9f-af17b4b5ecaa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:44.630276 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bfa1f9a4-41ac-42d0-bf9f-af17b4b5ecaa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:44.631059 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bfa1f9a4-41ac-42d0-bf9f-af17b4b5ecaa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:44.631498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bfa1f9a4-41ac-42d0-bf9f-af17b4b5ecaa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:44.661519 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bfa1f9a4-41ac-42d0-bf9f-af17b4b5ecaa tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Apr 12 16:25:44.661989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 498/996] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:25:44 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:45.674300 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d2670c9a-6667-465e-9664-a230c41bea24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:45.675329 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d2670c9a-6667-465e-9664-a230c41bea24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:45.683020 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d2670c9a-6667-465e-9664-a230c41bea24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:45.683473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d2670c9a-6667-465e-9664-a230c41bea24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:45.684251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d2670c9a-6667-465e-9664-a230c41bea24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:45.684720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d2670c9a-6667-465e-9664-a230c41bea24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:45.719531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d2670c9a-6667-465e-9664-a230c41bea24 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049854 Apr 12 16:25:45.720200 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 499/997] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:25:45 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:46.734678 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-482d2c0e-3993-46d2-b67b-9ece78b2ab20 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:46.735790 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-482d2c0e-3993-46d2-b67b-9ece78b2ab20 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:46.743484 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-482d2c0e-3993-46d2-b67b-9ece78b2ab20 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:46.743931 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-482d2c0e-3993-46d2-b67b-9ece78b2ab20 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:46.744704 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-482d2c0e-3993-46d2-b67b-9ece78b2ab20 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:46.745134 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-482d2c0e-3993-46d2-b67b-9ece78b2ab20 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:46.774221 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-482d2c0e-3993-46d2-b67b-9ece78b2ab20 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044818 Apr 12 16:25:46.774767 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 499/998] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:25:46 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:25:46.859884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-88aa74c9-4379-4add-ad64-e20bbcdbde02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:46.860475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-88aa74c9-4379-4add-ad64-e20bbcdbde02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:46.866943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-88aa74c9-4379-4add-ad64-e20bbcdbde02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:46.867395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-88aa74c9-4379-4add-ad64-e20bbcdbde02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:46.868170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-88aa74c9-4379-4add-ad64-e20bbcdbde02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:46.868610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-88aa74c9-4379-4add-ad64-e20bbcdbde02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:46.898499 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-88aa74c9-4379-4add-ad64-e20bbcdbde02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:25:46.981512 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-88aa74c9-4379-4add-ad64-e20bbcdbde02 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 204 len: 0 microversion: 2.1 time: 0.125248 Apr 12 16:25:46.982244 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 500/999] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:25:46 2022] DELETE /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:25:46.992518 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9f7f5cc0-78df-4b20-8112-b5cd63ce68fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:46.993348 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9f7f5cc0-78df-4b20-8112-b5cd63ce68fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:46.999942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9f7f5cc0-78df-4b20-8112-b5cd63ce68fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:47.000390 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9f7f5cc0-78df-4b20-8112-b5cd63ce68fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:47.001148 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9f7f5cc0-78df-4b20-8112-b5cd63ce68fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:47.001590 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9f7f5cc0-78df-4b20-8112-b5cd63ce68fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:47.139826 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-9f7f5cc0-78df-4b20-8112-b5cd63ce68fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:47.147689 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9f7f5cc0-78df-4b20-8112-b5cd63ce68fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1690 microversion: 2.1 time: 0.160039 Apr 12 16:25:47.148289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 500/1000] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:46 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:48.165063 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a4a3e5b8-b249-480a-8e09-b37054452323 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:48.166123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a4a3e5b8-b249-480a-8e09-b37054452323 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:48.172874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4a3e5b8-b249-480a-8e09-b37054452323 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:48.173338 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4a3e5b8-b249-480a-8e09-b37054452323 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:48.174156 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4a3e5b8-b249-480a-8e09-b37054452323 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:48.174599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a4a3e5b8-b249-480a-8e09-b37054452323 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:48.314596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a4a3e5b8-b249-480a-8e09-b37054452323 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:48.325667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a4a3e5b8-b249-480a-8e09-b37054452323 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1690 microversion: 2.1 time: 0.164901 Apr 12 16:25:48.326567 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 501/1001] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:48 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:49.344645 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2816c0c7-4118-4227-adc2-42fa7cc47d03 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:49.345237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2816c0c7-4118-4227-adc2-42fa7cc47d03 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:49.351967 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2816c0c7-4118-4227-adc2-42fa7cc47d03 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:49.352413 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2816c0c7-4118-4227-adc2-42fa7cc47d03 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:49.353219 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2816c0c7-4118-4227-adc2-42fa7cc47d03 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:49.353659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2816c0c7-4118-4227-adc2-42fa7cc47d03 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:49.493375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2816c0c7-4118-4227-adc2-42fa7cc47d03 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:49.501354 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2816c0c7-4118-4227-adc2-42fa7cc47d03 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1690 microversion: 2.1 time: 0.160887 Apr 12 16:25:49.501975 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 501/1002] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:49 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:50.519370 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0875353e-4fe8-49c5-b461-5095b92768f3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:50.519943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0875353e-4fe8-49c5-b461-5095b92768f3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:50.526656 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0875353e-4fe8-49c5-b461-5095b92768f3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:50.527101 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0875353e-4fe8-49c5-b461-5095b92768f3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:50.527868 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0875353e-4fe8-49c5-b461-5095b92768f3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:50.528296 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0875353e-4fe8-49c5-b461-5095b92768f3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:50.667139 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0875353e-4fe8-49c5-b461-5095b92768f3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:50.675818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0875353e-4fe8-49c5-b461-5095b92768f3 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1690 microversion: 2.1 time: 0.160434 Apr 12 16:25:50.676432 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 502/1003] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:50 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:51.697205 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f673c47a-015c-430d-abb9-b68582cc9b57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:51.698075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f673c47a-015c-430d-abb9-b68582cc9b57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:51.705202 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f673c47a-015c-430d-abb9-b68582cc9b57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:51.705659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f673c47a-015c-430d-abb9-b68582cc9b57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:51.706477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f673c47a-015c-430d-abb9-b68582cc9b57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:51.706916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f673c47a-015c-430d-abb9-b68582cc9b57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:51.843845 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f673c47a-015c-430d-abb9-b68582cc9b57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:51.854564 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f673c47a-015c-430d-abb9-b68582cc9b57 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1690 microversion: 2.1 time: 0.163948 Apr 12 16:25:51.855126 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 502/1004] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:51 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:52.872348 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cd5051f8-23ea-40c9-9687-a95db409b57a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:52.873010 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cd5051f8-23ea-40c9-9687-a95db409b57a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:52.879583 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cd5051f8-23ea-40c9-9687-a95db409b57a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:52.880035 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cd5051f8-23ea-40c9-9687-a95db409b57a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:52.880810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cd5051f8-23ea-40c9-9687-a95db409b57a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:52.881249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cd5051f8-23ea-40c9-9687-a95db409b57a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:52.967629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cd5051f8-23ea-40c9-9687-a95db409b57a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:52.975185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cd5051f8-23ea-40c9-9687-a95db409b57a tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 200 len: 1622 microversion: 2.1 time: 0.106992 Apr 12 16:25:52.975725 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 503/1005] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:52 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 1622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:53.045841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-c5eaa7a0-8403-40d6-addc-b60e6b24c6db req-d5ec68fc-b3be-4b23-a8bf-19d9ab733305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37fad20-9d1f-4785-ac0d-9babf6466375", "name": "network-vif-deleted", "tag": "a9b6c507-f16a-4011-8719-2d8d34825c2a"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:53.058924 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-c5eaa7a0-8403-40d6-addc-b60e6b24c6db req-d5ec68fc-b3be-4b23-a8bf-19d9ab733305 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:53.059532 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-c5eaa7a0-8403-40d6-addc-b60e6b24c6db req-d5ec68fc-b3be-4b23-a8bf-19d9ab733305 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:53.073187 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-c5eaa7a0-8403-40d6-addc-b60e6b24c6db req-d5ec68fc-b3be-4b23-a8bf-19d9ab733305 service nova] Creating event network-vif-deleted:a9b6c507-f16a-4011-8719-2d8d34825c2a for instance b37fad20-9d1f-4785-ac0d-9babf6466375 on hv-cinder-83752 Apr 12 16:25:53.079138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-c5eaa7a0-8403-40d6-addc-b60e6b24c6db req-d5ec68fc-b3be-4b23-a8bf-19d9ab733305 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042103 Apr 12 16:25:53.079995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 503/1006] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:53.992928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:53.993604 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: b37fad20-9d1f-4785-ac0d-9babf6466375] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:54.000052 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:54.000441 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:54.001252 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:54.001691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:54.016577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] HTTP exception thrown: Instance b37fad20-9d1f-4785-ac0d-9babf6466375 could not be found. Apr 12 16:25:54.017263 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Returning 404 to user: Instance b37fad20-9d1f-4785-ac0d-9babf6466375 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:25:54.018338 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-44f20ead-9239-4cfb-b9f6-a38f701c22cc tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375" status: 404 len: 111 microversion: 2.1 time: 0.029537 Apr 12 16:25:54.019053 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 504/1007] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:53 2022] GET /compute/v2.1/servers/b37fad20-9d1f-4785-ac0d-9babf6466375 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:25:54.028162 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e2cd2a86-40be-4d93-aa03-b73d9286277b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '.version_select at 0x7f246ddc2d30>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:54.047270 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e2cd2a86-40be-4d93-aa03-b73d9286277b tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778657825" status: 202 len: 0 microversion: 2.1 time: 0.023494 Apr 12 16:25:54.048326 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 504/1008] 10.222.0.67 () {58 vars in 1220 bytes} [Tue Apr 12 16:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778657825 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:25:56.989179 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3ebffd25-77af-4961-b6fd-0512e1fd44a7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:56.989823 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3ebffd25-77af-4961-b6fd-0512e1fd44a7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:56.997933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ebffd25-77af-4961-b6fd-0512e1fd44a7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:56.998413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ebffd25-77af-4961-b6fd-0512e1fd44a7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:56.999467 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ebffd25-77af-4961-b6fd-0512e1fd44a7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:57.000071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3ebffd25-77af-4961-b6fd-0512e1fd44a7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:57.029012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3ebffd25-77af-4961-b6fd-0512e1fd44a7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:25:57.107305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3ebffd25-77af-4961-b6fd-0512e1fd44a7 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 204 len: 0 microversion: 2.1 time: 0.121848 Apr 12 16:25:57.107894 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 505/1009] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:25:56 2022] DELETE /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:25:57.116603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-682c812f-8f6d-45a1-b7c9-01147ed09c08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:57.117339 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-682c812f-8f6d-45a1-b7c9-01147ed09c08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:57.124174 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-682c812f-8f6d-45a1-b7c9-01147ed09c08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:57.125125 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-682c812f-8f6d-45a1-b7c9-01147ed09c08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:57.126214 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-682c812f-8f6d-45a1-b7c9-01147ed09c08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:57.126712 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-682c812f-8f6d-45a1-b7c9-01147ed09c08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:57.264799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-682c812f-8f6d-45a1-b7c9-01147ed09c08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:57.272388 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-682c812f-8f6d-45a1-b7c9-01147ed09c08 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1504 microversion: 2.1 time: 0.160205 Apr 12 16:25:57.272934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 505/1010] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:57 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:58.290023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c2a09085-0ec8-4c04-9cf9-59878c6ebd66 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:58.290782 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c2a09085-0ec8-4c04-9cf9-59878c6ebd66 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:58.297103 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c2a09085-0ec8-4c04-9cf9-59878c6ebd66 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:58.297569 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c2a09085-0ec8-4c04-9cf9-59878c6ebd66 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:58.298386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c2a09085-0ec8-4c04-9cf9-59878c6ebd66 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:58.298833 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c2a09085-0ec8-4c04-9cf9-59878c6ebd66 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:58.398942 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c2a09085-0ec8-4c04-9cf9-59878c6ebd66 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:58.406636 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c2a09085-0ec8-4c04-9cf9-59878c6ebd66 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 200 len: 1462 microversion: 2.1 time: 0.121025 Apr 12 16:25:58.407219 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 506/1011] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:58 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 1462 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:58.433472 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-cfee75c0-01cf-4883-8e81-ca211b606c51 req-f7b91c94-1e23-4a05-a02d-4d824d48e245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d84741a-a53e-484d-b7c1-77df2336fa27", "name": "network-vif-deleted", "tag": "2b4a5c66-664f-4c45-97da-99ed8c2f0118"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:58.442866 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-cfee75c0-01cf-4883-8e81-ca211b606c51 req-f7b91c94-1e23-4a05-a02d-4d824d48e245 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:58.443314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-cfee75c0-01cf-4883-8e81-ca211b606c51 req-f7b91c94-1e23-4a05-a02d-4d824d48e245 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:58.455539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-cfee75c0-01cf-4883-8e81-ca211b606c51 req-f7b91c94-1e23-4a05-a02d-4d824d48e245 service nova] Creating event network-vif-deleted:2b4a5c66-664f-4c45-97da-99ed8c2f0118 for instance 5d84741a-a53e-484d-b7c1-77df2336fa27 on hv-cinder-83752 Apr 12 16:25:58.462290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-cfee75c0-01cf-4883-8e81-ca211b606c51 req-f7b91c94-1e23-4a05-a02d-4d824d48e245 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032192 Apr 12 16:25:58.463281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 506/1012] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:59.427138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:59.427941 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: 5d84741a-a53e-484d-b7c1-77df2336fa27] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:59.438305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:59.438986 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:59.440170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:59.440840 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:59.453686 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2dccf728-1a79-4164-95e5-b4e44c1af5c4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:59.454269 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2dccf728-1a79-4164-95e5-b4e44c1af5c4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:59.457349 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] HTTP exception thrown: Instance 5d84741a-a53e-484d-b7c1-77df2336fa27 could not be found. Apr 12 16:25:59.457968 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Returning 404 to user: Instance 5d84741a-a53e-484d-b7c1-77df2336fa27 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:25:59.458838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-32bfcbac-be79-477a-9acc-bb3636ad6c59 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27" status: 404 len: 111 microversion: 2.1 time: 0.037921 Apr 12 16:25:59.459403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 507/1013] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:59 2022] GET /compute/v2.1/servers/5d84741a-a53e-484d-b7c1-77df2336fa27 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:25:59.460747 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2dccf728-1a79-4164-95e5-b4e44c1af5c4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:59.461190 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2dccf728-1a79-4164-95e5-b4e44c1af5c4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:59.462026 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2dccf728-1a79-4164-95e5-b4e44c1af5c4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:59.462591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2dccf728-1a79-4164-95e5-b4e44c1af5c4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:59.467609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-83b4e1a1-2d05-446a-b474-ab1e065888e8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:59.468111 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-83b4e1a1-2d05-446a-b474-ab1e065888e8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:59.481957 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-83b4e1a1-2d05-446a-b474-ab1e065888e8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:59.482745 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-83b4e1a1-2d05-446a-b474-ab1e065888e8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:59.483741 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-83b4e1a1-2d05-446a-b474-ab1e065888e8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:59.484226 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-83b4e1a1-2d05-446a-b474-ab1e065888e8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:59.486375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2dccf728-1a79-4164-95e5-b4e44c1af5c4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/ips" status: 200 len: 152 microversion: 2.20 time: 0.037663 Apr 12 16:25:59.486966 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 507/1014] 10.222.0.67 () {60 vars in 1288 bytes} [Tue Apr 12 16:25:59 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:25:59.509913 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-83b4e1a1-2d05-446a-b474-ab1e065888e8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:25:59.588719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-83b4e1a1-2d05-446a-b474-ab1e065888e8 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 204 len: 0 microversion: 2.1 time: 0.124663 Apr 12 16:25:59.589526 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 508/1015] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:25:59 2022] DELETE /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:25:59.598871 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-05839909-e890-4f76-87a1-c1c7731bed53 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:59.599528 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-05839909-e890-4f76-87a1-c1c7731bed53 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:25:59.607741 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05839909-e890-4f76-87a1-c1c7731bed53 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:59.608429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05839909-e890-4f76-87a1-c1c7731bed53 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:59.609408 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05839909-e890-4f76-87a1-c1c7731bed53 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:25:59.609919 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-05839909-e890-4f76-87a1-c1c7731bed53 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:25:59.754534 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-05839909-e890-4f76-87a1-c1c7731bed53 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:25:59.761989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-05839909-e890-4f76-87a1-c1c7731bed53 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.168265 Apr 12 16:25:59.762595 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 508/1016] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:25:59 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:00.781821 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4c87b65b-2736-4712-9eaa-7c86528420b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:00.783115 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4c87b65b-2736-4712-9eaa-7c86528420b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:00.790975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4c87b65b-2736-4712-9eaa-7c86528420b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:00.791794 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4c87b65b-2736-4712-9eaa-7c86528420b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:00.792810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4c87b65b-2736-4712-9eaa-7c86528420b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:00.793258 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4c87b65b-2736-4712-9eaa-7c86528420b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:00.939467 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4c87b65b-2736-4712-9eaa-7c86528420b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:00.950114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4c87b65b-2736-4712-9eaa-7c86528420b6 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.173526 Apr 12 16:26:00.951036 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 509/1017] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:00 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:01.972440 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-91e41be4-f2b6-411c-8791-6c8fd93e1c80 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:01.973418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-91e41be4-f2b6-411c-8791-6c8fd93e1c80 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:01.984344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-91e41be4-f2b6-411c-8791-6c8fd93e1c80 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:01.985095 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-91e41be4-f2b6-411c-8791-6c8fd93e1c80 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:01.986437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-91e41be4-f2b6-411c-8791-6c8fd93e1c80 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:01.987173 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-91e41be4-f2b6-411c-8791-6c8fd93e1c80 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:02.126805 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-91e41be4-f2b6-411c-8791-6c8fd93e1c80 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:02.135439 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-91e41be4-f2b6-411c-8791-6c8fd93e1c80 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.169622 Apr 12 16:26:02.136034 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 509/1018] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:01 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:02.913837 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-337b5e45-2d44-411d-be48-8552267d0080 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:02.914428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-337b5e45-2d44-411d-be48-8552267d0080 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:02.921405 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-337b5e45-2d44-411d-be48-8552267d0080 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:02.921860 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-337b5e45-2d44-411d-be48-8552267d0080 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:02.922675 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-337b5e45-2d44-411d-be48-8552267d0080 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:02.923110 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-337b5e45-2d44-411d-be48-8552267d0080 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:02.946430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-337b5e45-2d44-411d-be48-8552267d0080 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lazy-loading 'flavor' on Instance uuid d79e2e80-5679-41bd-aab2-6e740d404eb7 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:03.153001 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-009c7f0c-fe78-48bb-abc4-37290b4ec237 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:03.153892 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-009c7f0c-fe78-48bb-abc4-37290b4ec237 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:03.160547 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-009c7f0c-fe78-48bb-abc4-37290b4ec237 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:03.161160 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-009c7f0c-fe78-48bb-abc4-37290b4ec237 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:03.161875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-009c7f0c-fe78-48bb-abc4-37290b4ec237 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:03.162375 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-009c7f0c-fe78-48bb-abc4-37290b4ec237 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:03.234191 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-337b5e45-2d44-411d-be48-8552267d0080 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/action" status: 202 len: 0 microversion: 2.20 time: 0.324282 Apr 12 16:26:03.234825 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 510/1019] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Apr 12 16:26:02 2022] POST /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:26:03.243606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:03.244593 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:03.256595 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:03.257054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:03.257909 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:03.258430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:03.308369 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-009c7f0c-fe78-48bb-abc4-37290b4ec237 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:03.316068 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-009c7f0c-fe78-48bb-abc4-37290b4ec237 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1519 microversion: 2.1 time: 0.167289 Apr 12 16:26:03.316837 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 510/1020] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:03 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:03.432345 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:03.444710 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:03.447707 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:03.449571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d7000ac6-146c-4880-a8bb-3fc47a722ed9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.210012 Apr 12 16:26:03.450766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 511/1021] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:03 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:26:03.928247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-95761556-7f8a-4c6a-921f-d06ec5cb7cdd req-d57db3f5-1390-49f7-9519-8fa293f5c683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e6a8f9-e6af-4d52-9722-25d9de08e9b5", "name": "network-vif-deleted", "tag": "1482398b-faf8-483e-b85f-481978b24399"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:03.937221 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-95761556-7f8a-4c6a-921f-d06ec5cb7cdd req-d57db3f5-1390-49f7-9519-8fa293f5c683 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:03.937574 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-95761556-7f8a-4c6a-921f-d06ec5cb7cdd req-d57db3f5-1390-49f7-9519-8fa293f5c683 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:03.954639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-95761556-7f8a-4c6a-921f-d06ec5cb7cdd req-d57db3f5-1390-49f7-9519-8fa293f5c683 service nova] Creating event network-vif-deleted:1482398b-faf8-483e-b85f-481978b24399 for instance f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 on hv-cinder-83752 Apr 12 16:26:03.959782 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-95761556-7f8a-4c6a-921f-d06ec5cb7cdd req-d57db3f5-1390-49f7-9519-8fa293f5c683 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036660 Apr 12 16:26:03.960642 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 511/1022] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:04.333891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:04.334503 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:04.341687 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:04.342127 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:04.343344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:04.343780 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:04.385098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:04.385546 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:04.385988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lazy-loading 'fault' on Instance uuid f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:04.428439 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a8dd6313744c0bac80289882e9b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd271496524c94929c1a28a63f96ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:04.436810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7af4d0b5-0b79-469e-a486-b78b499faed4 tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 200 len: 1311 microversion: 2.1 time: 0.106812 Apr 12 16:26:04.437383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 512/1023] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:04 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:04.475369 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:04.477255 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:04.483759 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:04.484414 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:04.485351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:04.485927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:04.626052 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:04.634021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:04.635528 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:04.636682 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-135cd394-89cd-44ac-ad4f-1f86f5a422b0 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.167105 Apr 12 16:26:04.637237 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 512/1024] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:04 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:05.459313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:05.460176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] [instance: f2e6a8f9-e6af-4d52-9722-25d9de08e9b5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:05.471358 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:05.472099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:05.473417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:05.474141 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:05.491327 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] HTTP exception thrown: Instance f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 could not be found. Apr 12 16:26:05.491908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] Returning 404 to user: Instance f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:26:05.492729 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-35cc1780-6da4-4069-8cb2-7f182522e6fe tempest-ServerRescueNegativeTestJSON-550096355 tempest-ServerRescueNegativeTestJSON-550096355-project] 10.222.0.67 "GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5" status: 404 len: 111 microversion: 2.1 time: 0.040228 Apr 12 16:26:05.493264 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 513/1025] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:05 2022] GET /compute/v2.1/servers/f2e6a8f9-e6af-4d52-9722-25d9de08e9b5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:26:05.656929 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:05.657541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:05.664940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:05.665463 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:05.666350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:05.666797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:05.797914 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:05.806334 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:05.807905 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:05.809077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-66bb0840-5dea-403d-b3f9-af8ac7f0f7cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.156193 Apr 12 16:26:05.809642 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 513/1026] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:05 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:06.827573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:06.828135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:06.834716 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:06.835172 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:06.835952 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:06.836387 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:06.977005 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:06.985609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:06.987152 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:06.988315 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-73a3300f-b5c9-4731-ad56-156b5679f979 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.165299 Apr 12 16:26:06.989074 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 514/1027] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:06 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:08.006556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:08.007740 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:08.015055 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:08.015512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:08.016307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:08.016723 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:08.165556 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:08.175328 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:08.178291 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:08.179750 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-217e3ddf-09c6-4a1b-8518-2f17fd1355b9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.177769 Apr 12 16:26:08.180545 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 514/1028] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:08 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:09.199173 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:09.199779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:09.206468 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:09.206918 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:09.207686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:09.208118 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:09.338183 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:09.349586 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:09.351245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:09.352858 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-27c1d2d1-8e2f-481f-a8ff-e4b41620e338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.157784 Apr 12 16:26:09.353573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 515/1029] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:09 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:10.371225 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:10.371829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:10.378312 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:10.378760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:10.379526 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:10.379955 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:10.512571 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:10.523875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:10.525551 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:10.526767 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d3e8d253-2201-4fb8-998e-7cc33491c478 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.159617 Apr 12 16:26:10.527330 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 515/1030] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:10 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:11.549187 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:11.550249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:11.558865 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:11.559318 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:11.560087 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:11.560524 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:11.698334 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:11.707026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:11.708492 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:11.709668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-07bf8fed-fdcb-45f0-b2b0-9b294d2c575a tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.167133 Apr 12 16:26:11.710284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 516/1031] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:11 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:12.728985 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:12.729597 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:12.736577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:12.737011 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:12.737787 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:12.738251 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:12.888153 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:12.896526 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:12.898020 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:12.899307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e11db96e-5b38-4dd7-a111-2b109a1d7f8b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.175211 Apr 12 16:26:12.899912 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 516/1032] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:12 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:13.917202 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:13.917820 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:13.924281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:13.924734 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:13.925513 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:13.925948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:14.082112 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:14.091265 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:14.092818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:14.094704 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-15067de4-d94f-4cf8-a9dc-83fcf18d1f9b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.181169 Apr 12 16:26:14.095425 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 517/1033] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:13 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:15.116001 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:15.116649 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:15.123355 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:15.123905 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:15.124695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:15.125111 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:15.265050 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:15.272969 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:15.274848 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:15.276020 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a574a2c4-9244-4811-b1d4-a23421d41594 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.164088 Apr 12 16:26:15.276609 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 517/1034] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:15 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:16.294490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:16.295192 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:16.301655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:16.302228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:16.303095 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:16.303624 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:16.436761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:16.446299 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:16.447899 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:16.449142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ee8a7508-e4ad-47a2-94e9-c29494cb7707 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.158585 Apr 12 16:26:16.449697 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 518/1035] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:16 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:17.468248 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:17.469035 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:17.478124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:17.478124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:17.479539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:17.479984 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:17.615655 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:17.627918 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:17.629513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:17.630715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b0e686ed-9950-4fc6-b120-3fd174313205 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.166635 Apr 12 16:26:17.631274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 518/1036] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:17 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:18.649862 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:18.650502 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:18.657035 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:18.657485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:18.658287 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:18.658725 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:18.842481 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:18.850462 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:18.852468 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:18.853999 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-572cc866-2b12-4145-bf2e-5d8670d6a8b5 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.208243 Apr 12 16:26:18.854607 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 519/1037] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:18 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:19.872524 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:19.873128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:19.879089 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:19.879535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:19.880332 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:19.880727 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:20.017083 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:20.025586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:20.027927 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:20.029186 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-df1e6b37-ea5d-43ef-95df-7d2a3eaff333 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1744 microversion: 2.20 time: 0.160587 Apr 12 16:26:20.029924 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 519/1038] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:19 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:21.050009 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:21.050746 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:21.058362 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:21.058882 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:21.059791 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:21.060313 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:21.208520 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:21.212527 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:21.214083 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:21.215251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-74e9fc05-1e2a-4204-9ad8-cdd2c203dcec tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1744 microversion: 2.20 time: 0.169903 Apr 12 16:26:21.215809 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 520/1039] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:21 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:22.234574 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:22.235454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:22.242366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:22.242989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:22.243792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:22.244266 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:22.386818 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:22.395050 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:22.396545 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:22.397715 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-634521b6-474e-42a2-bd5c-995ed394085c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.167569 Apr 12 16:26:22.398435 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 520/1040] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:22 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:23.417455 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:23.419110 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:23.427555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:23.428241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:23.429367 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:23.429965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:23.651375 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:23.657692 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-88b38230-9e4d-4f11-bb51-59a352147401 req-b74581c5-7713-4c7f-8c11-44b5cbb2ef00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79e2e80-5679-41bd-aab2-6e740d404eb7", "name": "network-vif-plugged", "status": "completed", "tag": "ea4a126a-a7f5-4e56-928d-bd76dc66e823"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:23.667301 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:23.670711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:23.674778 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5c7725c7-e916-425a-a9e6-099bc01e6c07 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.261441 Apr 12 16:26:23.675945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-88b38230-9e4d-4f11-bb51-59a352147401 req-b74581c5-7713-4c7f-8c11-44b5cbb2ef00 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:23.676876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 521/1041] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:23 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:23.677771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-88b38230-9e4d-4f11-bb51-59a352147401 req-b74581c5-7713-4c7f-8c11-44b5cbb2ef00 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:23.690699 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-88b38230-9e4d-4f11-bb51-59a352147401 req-b74581c5-7713-4c7f-8c11-44b5cbb2ef00 service nova] Creating event network-vif-plugged:ea4a126a-a7f5-4e56-928d-bd76dc66e823 for instance d79e2e80-5679-41bd-aab2-6e740d404eb7 on hv-cinder-83752 Apr 12 16:26:23.697272 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-88b38230-9e4d-4f11-bb51-59a352147401 req-b74581c5-7713-4c7f-8c11-44b5cbb2ef00 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043917 Apr 12 16:26:23.697988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 521/1042] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:24.695203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:24.695824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:24.702876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:24.703602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:24.704608 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:24.705216 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:25.240801 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:25.250016 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:25.251543 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:25.252763 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-08098c7e-a4d8-4b55-a844-a6ba890c66f9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.561763 Apr 12 16:26:25.264986 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 522/1043] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:24 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:26.272797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:26.274633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:26.282798 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:26.283494 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:26.284988 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:26.285766 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:26.521444 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:26.530975 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:26.532456 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:26.533708 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e42cda22-8f97-4ae3-b16b-f6f0aee7b65b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.265596 Apr 12 16:26:26.534707 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 522/1044] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:26 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:27.552224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:27.552886 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:27.554457 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1895409665", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "networks": [{"uuid": "4fe30bf7-e15a-43ab-a3df-92a56de425ea"}]}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:27.561079 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:27.562529 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:27.563309 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:27.566469 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:27.649267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] validate_networks() for [('4fe30bf7-e15a-43ab-a3df-92a56de425ea', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:26:27.804140 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:27.814605 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:27.816490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:27.818461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c430f5ea-3876-4857-8658-0333ae27551b tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.270569 Apr 12 16:26:27.819519 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 523/1045] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:27 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:28.165256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:26:28.165778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:26:28.166489 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:26:28.168128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:26:28.169102 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:26:28.194873 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:28.195318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:28.196498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:28.197089 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:28.215286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Getting quotas for project 5fda4b0004a04e11b47261d4874b63c1. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:26:28.219225 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Getting quotas for user 9b1aa676916c4af0b019ddb174ff4556 and project 5fda4b0004a04e11b47261d4874b63c1. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:26:28.231079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:26:28.233885 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:26:28.283031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5f0b58ee-0dbe-4bac-8ff7-0ebded04be02 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731897 Apr 12 16:26:28.287843 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 523/1046] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:26:28.293137 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-596991f9-938b-47b5-bb69-8f779c8eafd9 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:28.293761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-596991f9-938b-47b5-bb69-8f779c8eafd9 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:28.355899 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-596991f9-938b-47b5-bb69-8f779c8eafd9 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:28.363391 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-596991f9-938b-47b5-bb69-8f779c8eafd9 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1214 microversion: 2.1 time: 0.074130 Apr 12 16:26:28.371588 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 524/1047] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:28 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:28.837553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:28.838348 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:28.854390 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:28.855002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:28.856084 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:28.856535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:29.016633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:29.025760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:29.027720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:29.032224 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-45633172-0f9f-43b6-a777-65b5318b7106 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.199493 Apr 12 16:26:29.044574 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 524/1048] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:28 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:29.381582 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9fdf52d6-0f85-4dc1-aeef-af4e69e1c2e2 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:29.382284 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9fdf52d6-0f85-4dc1-aeef-af4e69e1c2e2 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:29.389315 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fdf52d6-0f85-4dc1-aeef-af4e69e1c2e2 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:29.389999 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fdf52d6-0f85-4dc1-aeef-af4e69e1c2e2 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:29.390982 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fdf52d6-0f85-4dc1-aeef-af4e69e1c2e2 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:29.391586 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9fdf52d6-0f85-4dc1-aeef-af4e69e1c2e2 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:29.453587 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9fdf52d6-0f85-4dc1-aeef-af4e69e1c2e2 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:29.461621 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9fdf52d6-0f85-4dc1-aeef-af4e69e1c2e2 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1266 microversion: 2.1 time: 0.084639 Apr 12 16:26:29.462671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 525/1049] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:29 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:29.979990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d17a6f43-e41c-4b18-9bc9-256528f4c427 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:29.981185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d17a6f43-e41c-4b18-9bc9-256528f4c427 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:30.000077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d17a6f43-e41c-4b18-9bc9-256528f4c427 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:30.002589 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d17a6f43-e41c-4b18-9bc9-256528f4c427 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:30.003591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d17a6f43-e41c-4b18-9bc9-256528f4c427 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:30.006579 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d17a6f43-e41c-4b18-9bc9-256528f4c427 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:30.050420 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:30.051452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:30.060008 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:30.061657 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d17a6f43-e41c-4b18-9bc9-256528f4c427 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/ips" status: 200 len: 147 microversion: 2.1 time: 0.092103 Apr 12 16:26:30.062326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:30.063415 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:30.065559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:30.069739 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 525/1050] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:26:29 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/ips => generated 147 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:30.339015 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:30.350325 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:30.352418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:30.354135 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-257e0540-a6f4-4a8b-997b-7097feaed6c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.307800 Apr 12 16:26:30.358354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 526/1051] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:30 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:30.483605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-dc8afd3e-e6ce-4b5b-a477-70d71750dcf7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:30.484482 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-dc8afd3e-e6ce-4b5b-a477-70d71750dcf7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:30.498850 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dc8afd3e-e6ce-4b5b-a477-70d71750dcf7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:30.499816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dc8afd3e-e6ce-4b5b-a477-70d71750dcf7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:30.502274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dc8afd3e-e6ce-4b5b-a477-70d71750dcf7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:30.506469 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dc8afd3e-e6ce-4b5b-a477-70d71750dcf7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:30.620983 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dc8afd3e-e6ce-4b5b-a477-70d71750dcf7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:30.628735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-dc8afd3e-e6ce-4b5b-a477-70d71750dcf7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1272 microversion: 2.1 time: 0.152421 Apr 12 16:26:30.629946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 526/1052] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:30 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:31.376123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:31.377683 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:31.389365 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:31.395512 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:31.396655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:31.397676 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:31.606623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-85e523b3-575e-4d7b-8776-f71ae4990fff tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f53a86c6-584d-4f89-9176-0d2a9e4442fe"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:31.607767 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-85e523b3-575e-4d7b-8776-f71ae4990fff tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:31.618405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85e523b3-575e-4d7b-8776-f71ae4990fff tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:31.619210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85e523b3-575e-4d7b-8776-f71ae4990fff tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:31.620272 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85e523b3-575e-4d7b-8776-f71ae4990fff tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:31.621486 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-85e523b3-575e-4d7b-8776-f71ae4990fff tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:31.722480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:31.737327 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:31.742444 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:31.744471 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b30e69f2-928c-4056-be00-dc77c2f21b25 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.372739 Apr 12 16:26:31.760731 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 527/1053] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:31 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:31.769580 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-96f353ab-3b14-49da-a79f-389ac80b4ebd tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:31.774296 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-96f353ab-3b14-49da-a79f-389ac80b4ebd tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:31.787093 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-96f353ab-3b14-49da-a79f-389ac80b4ebd tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:31.787929 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-96f353ab-3b14-49da-a79f-389ac80b4ebd tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:31.789451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-96f353ab-3b14-49da-a79f-389ac80b4ebd tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:31.790197 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-96f353ab-3b14-49da-a79f-389ac80b4ebd tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:32.011288 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-85e523b3-575e-4d7b-8776-f71ae4990fff tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410269 Apr 12 16:26:32.017422 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 527/1054] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:26:31 2022] POST /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:32.064800 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-2c88ecff-b82c-40b1-860b-5ebc41c47779 req-f3c54a58-45d8-4123-9b94-71b28adad214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab5e017-4c60-427d-adbd-b1e5c59f96f1", "tag": "3245f2df-9d4e-44e8-9884-884ef52ac9a1"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:32.065577 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-96f353ab-3b14-49da-a79f-389ac80b4ebd tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:32.076295 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-96f353ab-3b14-49da-a79f-389ac80b4ebd tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1314 microversion: 2.1 time: 0.312668 Apr 12 16:26:32.079494 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 528/1055] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:31 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:32.098992 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2c88ecff-b82c-40b1-860b-5ebc41c47779 req-f3c54a58-45d8-4123-9b94-71b28adad214 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:32.099760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2c88ecff-b82c-40b1-860b-5ebc41c47779 req-f3c54a58-45d8-4123-9b94-71b28adad214 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:32.133624 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-2c88ecff-b82c-40b1-860b-5ebc41c47779 req-f3c54a58-45d8-4123-9b94-71b28adad214 service nova] Creating event network-changed:3245f2df-9d4e-44e8-9884-884ef52ac9a1 for instance dab5e017-4c60-427d-adbd-b1e5c59f96f1 on hv-cinder-83752 Apr 12 16:26:32.139088 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-2c88ecff-b82c-40b1-860b-5ebc41c47779 req-f3c54a58-45d8-4123-9b94-71b28adad214 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078227 Apr 12 16:26:32.140166 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 528/1056] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:32.765659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:32.766245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:32.775241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:32.775700 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:32.776487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:32.776926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:32.931469 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:32.943653 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:32.945592 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:32.946783 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-17ad2b23-2071-47c1-83c5-590e3843534e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1739 microversion: 2.20 time: 0.187581 Apr 12 16:26:32.947630 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 529/1057] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:32 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:33.097179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b29b9cf9-dd2e-4f81-af39-95ac7357ded8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:33.097890 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b29b9cf9-dd2e-4f81-af39-95ac7357ded8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:33.105886 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b29b9cf9-dd2e-4f81-af39-95ac7357ded8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:33.106397 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b29b9cf9-dd2e-4f81-af39-95ac7357ded8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:33.107270 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b29b9cf9-dd2e-4f81-af39-95ac7357ded8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:33.107743 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b29b9cf9-dd2e-4f81-af39-95ac7357ded8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:33.259486 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b29b9cf9-dd2e-4f81-af39-95ac7357ded8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:33.271238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b29b9cf9-dd2e-4f81-af39-95ac7357ded8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1314 microversion: 2.1 time: 0.181074 Apr 12 16:26:33.272078 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 529/1058] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:33 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:33.974685 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:33.976048 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:33.982613 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:33.983057 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:33.983820 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:33.984254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:34.126834 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:34.135519 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:34.137310 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:34.138526 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f07aec53-9665-4863-afc5-2ea26e481daa tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1721 microversion: 2.20 time: 0.170422 Apr 12 16:26:34.139066 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 530/1059] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:33 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:34.293132 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e21b784a-3a35-43c7-9d79-a6ca209f9af7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:34.294838 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e21b784a-3a35-43c7-9d79-a6ca209f9af7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:34.301366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e21b784a-3a35-43c7-9d79-a6ca209f9af7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:34.301887 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e21b784a-3a35-43c7-9d79-a6ca209f9af7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:34.302754 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e21b784a-3a35-43c7-9d79-a6ca209f9af7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:34.303242 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e21b784a-3a35-43c7-9d79-a6ca209f9af7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:34.510627 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e21b784a-3a35-43c7-9d79-a6ca209f9af7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:34.521390 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e21b784a-3a35-43c7-9d79-a6ca209f9af7 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1314 microversion: 2.1 time: 0.232235 Apr 12 16:26:34.521947 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 530/1060] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:34 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:35.161049 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:35.161962 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:35.172222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:35.172673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:35.173480 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:35.173908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:35.326449 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:35.335121 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:35.336613 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:35.337776 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7314b746-5529-4e11-b9d8-93ed00c505e9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1721 microversion: 2.20 time: 0.182975 Apr 12 16:26:35.338386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 531/1061] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:35 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:35.541468 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6179e9c7-26ba-4855-8645-fc432d28381e tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:35.542074 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6179e9c7-26ba-4855-8645-fc432d28381e tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:35.550131 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6179e9c7-26ba-4855-8645-fc432d28381e tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:35.550563 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6179e9c7-26ba-4855-8645-fc432d28381e tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:35.551347 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6179e9c7-26ba-4855-8645-fc432d28381e tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:35.551809 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6179e9c7-26ba-4855-8645-fc432d28381e tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:35.685267 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6179e9c7-26ba-4855-8645-fc432d28381e tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:35.693418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6179e9c7-26ba-4855-8645-fc432d28381e tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1314 microversion: 2.1 time: 0.156324 Apr 12 16:26:35.693986 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 531/1062] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:35 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:35.765972 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-aa216288-b855-4f7f-b0ed-7fe9a3b577e5 req-3d910646-3481-4a48-aee7-0566103313cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79e2e80-5679-41bd-aab2-6e740d404eb7", "name": "network-vif-unplugged", "status": "completed", "tag": "ea4a126a-a7f5-4e56-928d-bd76dc66e823"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:35.774702 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-aa216288-b855-4f7f-b0ed-7fe9a3b577e5 req-3d910646-3481-4a48-aee7-0566103313cb service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:35.775158 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-aa216288-b855-4f7f-b0ed-7fe9a3b577e5 req-3d910646-3481-4a48-aee7-0566103313cb service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:35.787440 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-aa216288-b855-4f7f-b0ed-7fe9a3b577e5 req-3d910646-3481-4a48-aee7-0566103313cb service nova] Creating event network-vif-unplugged:ea4a126a-a7f5-4e56-928d-bd76dc66e823 for instance d79e2e80-5679-41bd-aab2-6e740d404eb7 on hv-cinder-83752 Apr 12 16:26:35.793095 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-aa216288-b855-4f7f-b0ed-7fe9a3b577e5 req-3d910646-3481-4a48-aee7-0566103313cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031071 Apr 12 16:26:35.793629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 532/1063] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:36.191273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8d16c53d-010e-434b-852d-bf1ec8e8d1b5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:36.191781 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8d16c53d-010e-434b-852d-bf1ec8e8d1b5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:36.198340 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8d16c53d-010e-434b-852d-bf1ec8e8d1b5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:36.198789 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8d16c53d-010e-434b-852d-bf1ec8e8d1b5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:36.199880 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8d16c53d-010e-434b-852d-bf1ec8e8d1b5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:36.200316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8d16c53d-010e-434b-852d-bf1ec8e8d1b5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:36.224256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8d16c53d-010e-434b-852d-bf1ec8e8d1b5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/ips" status: 200 len: 150 microversion: 2.1 time: 0.035861 Apr 12 16:26:36.224256 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 532/1064] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:26:36 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:36.365928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:36.367412 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:36.375659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:36.376751 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:36.377760 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:36.378249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:36.543990 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:36.556736 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:36.558964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:36.562140 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b932fd23-2941-40f2-90f7-7c53447bdb58 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1721 microversion: 2.20 time: 0.199924 Apr 12 16:26:36.562999 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 533/1065] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:36 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:26:36.710713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-fc11f698-8ae3-4c62-ac7e-d09d9266c36f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:36.711301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-fc11f698-8ae3-4c62-ac7e-d09d9266c36f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:36.717752 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fc11f698-8ae3-4c62-ac7e-d09d9266c36f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:36.718253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fc11f698-8ae3-4c62-ac7e-d09d9266c36f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:36.719073 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fc11f698-8ae3-4c62-ac7e-d09d9266c36f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:36.719504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fc11f698-8ae3-4c62-ac7e-d09d9266c36f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:36.858079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-fc11f698-8ae3-4c62-ac7e-d09d9266c36f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:36.865787 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-fc11f698-8ae3-4c62-ac7e-d09d9266c36f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1314 microversion: 2.1 time: 0.158931 Apr 12 16:26:36.866407 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 533/1066] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:36 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:37.581673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:37.582371 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:37.589392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:37.589846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:37.590671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:37.591111 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:37.731487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:37.740624 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:37.742498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:37.743846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0808a139-7a96-4ff6-bcd3-83f1f3f96fcb tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1664 microversion: 2.20 time: 0.166497 Apr 12 16:26:37.744555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 534/1067] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:37 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:37.753749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9d7cb962-dd45-4090-81b3-eb88a287da75 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd0ffed0-97b8-4b43-8b36-8cc905330763"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:37.754849 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-9d7cb962-dd45-4090-81b3-eb88a287da75 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:37.762132 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d7cb962-dd45-4090-81b3-eb88a287da75 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:37.762746 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-86af37c3-39cc-41a9-9b0a-4c002feab190 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "849d0130-ba84-4c32-a7ad-b50bf34b951d"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:37.762909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d7cb962-dd45-4090-81b3-eb88a287da75 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:37.763602 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d7cb962-dd45-4090-81b3-eb88a287da75 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:37.763801 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-86af37c3-39cc-41a9-9b0a-4c002feab190 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:37.764031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-9d7cb962-dd45-4090-81b3-eb88a287da75 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:37.769678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-86af37c3-39cc-41a9-9b0a-4c002feab190 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:37.770162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-86af37c3-39cc-41a9-9b0a-4c002feab190 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:37.771122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-86af37c3-39cc-41a9-9b0a-4c002feab190 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:37.771582 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-86af37c3-39cc-41a9-9b0a-4c002feab190 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.033694 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9d7cb962-dd45-4090-81b3-eb88a287da75 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "POST /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283719 Apr 12 16:26:38.034639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 534/1068] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:26:37 2022] POST /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:38.045212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-51468a5d-6d68-4c22-8c53-281305b8c74e req-11524d12-cfaa-45a8-89fe-5e16258ecf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab5e017-4c60-427d-adbd-b1e5c59f96f1", "name": "network-vif-plugged", "status": "completed", "tag": "3245f2df-9d4e-44e8-9884-884ef52ac9a1"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:38.054921 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-51468a5d-6d68-4c22-8c53-281305b8c74e req-11524d12-cfaa-45a8-89fe-5e16258ecf09 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.055358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-51468a5d-6d68-4c22-8c53-281305b8c74e req-11524d12-cfaa-45a8-89fe-5e16258ecf09 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.068695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-51468a5d-6d68-4c22-8c53-281305b8c74e req-11524d12-cfaa-45a8-89fe-5e16258ecf09 service nova] Creating event network-vif-plugged:3245f2df-9d4e-44e8-9884-884ef52ac9a1 for instance dab5e017-4c60-427d-adbd-b1e5c59f96f1 on hv-cinder-83752 Apr 12 16:26:38.073990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-51468a5d-6d68-4c22-8c53-281305b8c74e req-11524d12-cfaa-45a8-89fe-5e16258ecf09 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033235 Apr 12 16:26:38.074924 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 535/1069] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:38.080154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6220e242-1ada-4090-9fd9-ba0db10c0770 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:38.080897 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6220e242-1ada-4090-9fd9-ba0db10c0770 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:38.087514 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-86af37c3-39cc-41a9-9b0a-4c002feab190 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327981 Apr 12 16:26:38.088283 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6220e242-1ada-4090-9fd9-ba0db10c0770 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.088730 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6220e242-1ada-4090-9fd9-ba0db10c0770 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.088898 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 535/1070] 10.222.0.67 () {62 vars in 1363 bytes} [Tue Apr 12 16:26:37 2022] POST /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:26:38.089663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6220e242-1ada-4090-9fd9-ba0db10c0770 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.090172 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6220e242-1ada-4090-9fd9-ba0db10c0770 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.226905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0747479f-1e28-442d-8e13-d24cb23fd48d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:38.227423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0747479f-1e28-442d-8e13-d24cb23fd48d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:38.234290 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0747479f-1e28-442d-8e13-d24cb23fd48d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.234751 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0747479f-1e28-442d-8e13-d24cb23fd48d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.235531 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0747479f-1e28-442d-8e13-d24cb23fd48d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.235940 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0747479f-1e28-442d-8e13-d24cb23fd48d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.266515 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-6220e242-1ada-4090-9fd9-ba0db10c0770 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:38.274799 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6220e242-1ada-4090-9fd9-ba0db10c0770 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1314 microversion: 2.1 time: 0.198686 Apr 12 16:26:38.275728 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 536/1071] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:38 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:38.474890 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0747479f-1e28-442d-8e13-d24cb23fd48d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/os-volume_attachments/849d0130-ba84-4c32-a7ad-b50bf34b951d" status: 202 len: 0 microversion: 2.20 time: 0.252359 Apr 12 16:26:38.475686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 536/1072] 10.222.0.67 () {60 vars in 1456 bytes} [Tue Apr 12 16:26:38 2022] DELETE /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/os-volume_attachments/849d0130-ba84-4c32-a7ad-b50bf34b951d => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:26:38.531879 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-070cb1a3-978e-4d4c-b5b6-b7e6f7200cf4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:38.532450 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-070cb1a3-978e-4d4c-b5b6-b7e6f7200cf4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:38.539771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-070cb1a3-978e-4d4c-b5b6-b7e6f7200cf4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.540238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-070cb1a3-978e-4d4c-b5b6-b7e6f7200cf4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.541041 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-070cb1a3-978e-4d4c-b5b6-b7e6f7200cf4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.541476 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-070cb1a3-978e-4d4c-b5b6-b7e6f7200cf4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.645025 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-070cb1a3-978e-4d4c-b5b6-b7e6f7200cf4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "POST /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/action" status: 202 len: 0 microversion: 2.20 time: 0.117097 Apr 12 16:26:38.645942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 537/1073] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Apr 12 16:26:38 2022] POST /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:26:38.654508 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:38.655225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:38.662170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.662764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.663662 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:38.664220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:38.797914 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:38.806125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:38.807603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:38.808735 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-528c251e-4acc-45fe-a8eb-bc7864fae30f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1672 microversion: 2.20 time: 0.158211 Apr 12 16:26:38.809293 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 537/1074] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:38 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:39.292505 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8b7a5c71-6bc0-4fac-8729-bc09f1ce8542 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:39.293075 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8b7a5c71-6bc0-4fac-8729-bc09f1ce8542 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:39.300205 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8b7a5c71-6bc0-4fac-8729-bc09f1ce8542 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:39.300664 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8b7a5c71-6bc0-4fac-8729-bc09f1ce8542 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:39.301420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8b7a5c71-6bc0-4fac-8729-bc09f1ce8542 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:39.301846 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8b7a5c71-6bc0-4fac-8729-bc09f1ce8542 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:39.455384 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8b7a5c71-6bc0-4fac-8729-bc09f1ce8542 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:39.463461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8b7a5c71-6bc0-4fac-8729-bc09f1ce8542 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1314 microversion: 2.1 time: 0.175585 Apr 12 16:26:39.464035 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 538/1075] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:39 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:39.829985 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:39.830871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:39.840220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:39.840688 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:39.841893 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:39.842555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:39.992610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:40.004024 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:40.006425 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:40.007809 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b73231b9-fc55-4d72-bef9-556dc120315f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1674 microversion: 2.20 time: 0.183657 Apr 12 16:26:40.008349 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 538/1076] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:39 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:40.481759 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-93942f6b-ece9-4383-8f7b-1f3406e9833b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:40.482378 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-93942f6b-ece9-4383-8f7b-1f3406e9833b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:40.489236 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93942f6b-ece9-4383-8f7b-1f3406e9833b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:40.489695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93942f6b-ece9-4383-8f7b-1f3406e9833b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:40.490512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93942f6b-ece9-4383-8f7b-1f3406e9833b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:40.490954 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93942f6b-ece9-4383-8f7b-1f3406e9833b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:40.643985 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-93942f6b-ece9-4383-8f7b-1f3406e9833b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:40.653245 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-93942f6b-ece9-4383-8f7b-1f3406e9833b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1497 microversion: 2.1 time: 0.176201 Apr 12 16:26:40.653831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 539/1077] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:40 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:41.031514 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:41.032116 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:41.042103 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.042787 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.044007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.044628 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.194234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:41.202596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:41.204269 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:41.205458 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-5888771c-6c6b-4c3f-b632-4b2fd0a3ffe2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.180106 Apr 12 16:26:41.206006 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 539/1078] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:41 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:41.207181 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3951db1a-3f7f-41d8-bedd-83c465521e7f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:41.207758 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3951db1a-3f7f-41d8-bedd-83c465521e7f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:41.223025 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3951db1a-3f7f-41d8-bedd-83c465521e7f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.223400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3951db1a-3f7f-41d8-bedd-83c465521e7f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.225420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3951db1a-3f7f-41d8-bedd-83c465521e7f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.225420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3951db1a-3f7f-41d8-bedd-83c465521e7f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.259565 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3951db1a-3f7f-41d8-bedd-83c465521e7f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Going to try to terminate instance {{(pid=117201) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:26:41.341951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3951db1a-3f7f-41d8-bedd-83c465521e7f tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 204 len: 0 microversion: 2.1 time: 0.138358 Apr 12 16:26:41.342586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 540/1079] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:26:41 2022] DELETE /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:26:41.351361 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d49c0f52-b0b3-44bf-8ba2-08ca22b534eb tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:41.352220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d49c0f52-b0b3-44bf-8ba2-08ca22b534eb tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:41.358230 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d49c0f52-b0b3-44bf-8ba2-08ca22b534eb tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.358691 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d49c0f52-b0b3-44bf-8ba2-08ca22b534eb tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.359515 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d49c0f52-b0b3-44bf-8ba2-08ca22b534eb tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.359965 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d49c0f52-b0b3-44bf-8ba2-08ca22b534eb tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.508674 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d49c0f52-b0b3-44bf-8ba2-08ca22b534eb tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:41.516584 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d49c0f52-b0b3-44bf-8ba2-08ca22b534eb tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1503 microversion: 2.1 time: 0.169283 Apr 12 16:26:41.517151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 540/1080] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:41 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:41.708601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-7f71e2b4-435c-49d6-971a-c0fb68f2533d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:41.709792 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-7f71e2b4-435c-49d6-971a-c0fb68f2533d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:41.716599 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f71e2b4-435c-49d6-971a-c0fb68f2533d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.717054 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f71e2b4-435c-49d6-971a-c0fb68f2533d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.717829 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f71e2b4-435c-49d6-971a-c0fb68f2533d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.718308 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-7f71e2b4-435c-49d6-971a-c0fb68f2533d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.748043 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-7f71e2b4-435c-49d6-971a-c0fb68f2533d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Apr 12 16:26:41.748585 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 541/1081] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:26:41 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:41.763381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-db7a493b-6a83-443c-81a2-a26142758776 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:41.764172 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-db7a493b-6a83-443c-81a2-a26142758776 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:41.772996 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db7a493b-6a83-443c-81a2-a26142758776 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.773452 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db7a493b-6a83-443c-81a2-a26142758776 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.774333 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db7a493b-6a83-443c-81a2-a26142758776 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:41.774773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db7a493b-6a83-443c-81a2-a26142758776 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:41.803939 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-db7a493b-6a83-443c-81a2-a26142758776 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/f53a86c6-584d-4f89-9176-0d2a9e4442fe" status: 200 len: 194 microversion: 2.1 time: 0.046908 Apr 12 16:26:41.804518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 541/1082] 10.222.0.67 () {58 vars in 1412 bytes} [Tue Apr 12 16:26:41 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/f53a86c6-584d-4f89-9176-0d2a9e4442fe => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:42.225386 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:42.226095 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:42.232697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:42.233241 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:42.234060 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:42.234544 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:42.372945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:42.384832 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:42.387316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:42.389003 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-953cc210-bfca-4239-b5e5-b4adbbc2463f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.167592 Apr 12 16:26:42.389689 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 542/1083] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:42 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:42.538496 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ff7128f4-b89e-4223-8861-75b1c90de53c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:42.539071 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ff7128f4-b89e-4223-8861-75b1c90de53c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:42.548484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff7128f4-b89e-4223-8861-75b1c90de53c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:42.549288 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff7128f4-b89e-4223-8861-75b1c90de53c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:42.550794 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff7128f4-b89e-4223-8861-75b1c90de53c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:42.551546 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ff7128f4-b89e-4223-8861-75b1c90de53c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:42.692114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ff7128f4-b89e-4223-8861-75b1c90de53c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:42.701240 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ff7128f4-b89e-4223-8861-75b1c90de53c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1503 microversion: 2.1 time: 0.168969 Apr 12 16:26:42.701816 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 542/1084] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:42 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:43.152645 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-037b3fb4-2875-4073-9064-c10daedc31f2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a39363f2-0f6c-4b5a-810c-23922f2d463c"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:43.153831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-037b3fb4-2875-4073-9064-c10daedc31f2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:43.160656 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-037b3fb4-2875-4073-9064-c10daedc31f2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:43.161359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-037b3fb4-2875-4073-9064-c10daedc31f2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:43.162180 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-037b3fb4-2875-4073-9064-c10daedc31f2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:43.162823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-037b3fb4-2875-4073-9064-c10daedc31f2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:43.410281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:43.411542 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:43.419020 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:43.419802 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:43.420928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:43.421755 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:43.439107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-037b3fb4-2875-4073-9064-c10daedc31f2 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "POST /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290323 Apr 12 16:26:43.439734 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 543/1085] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Apr 12 16:26:43 2022] POST /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:43.615486 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-02cd8a32-343b-4942-9796-5bd001e349ec req-d363ffc1-eaa1-4a0f-b31f-91168ae4ccb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab5e017-4c60-427d-adbd-b1e5c59f96f1", "name": "network-vif-deleted", "tag": "3245f2df-9d4e-44e8-9884-884ef52ac9a1"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:43.621483 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:43.624989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-02cd8a32-343b-4942-9796-5bd001e349ec req-d363ffc1-eaa1-4a0f-b31f-91168ae4ccb0 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:43.625504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-02cd8a32-343b-4942-9796-5bd001e349ec req-d363ffc1-eaa1-4a0f-b31f-91168ae4ccb0 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:43.632167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:43.635110 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:43.637451 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0a8927ab-48b4-4119-b9d9-ce3a4b693286 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.231622 Apr 12 16:26:43.638474 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 543/1086] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:43 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:26:43.639477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-02cd8a32-343b-4942-9796-5bd001e349ec req-d363ffc1-eaa1-4a0f-b31f-91168ae4ccb0 service nova] Creating event network-vif-deleted:3245f2df-9d4e-44e8-9884-884ef52ac9a1 for instance dab5e017-4c60-427d-adbd-b1e5c59f96f1 on hv-cinder-83752 Apr 12 16:26:43.644847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-02cd8a32-343b-4942-9796-5bd001e349ec req-d363ffc1-eaa1-4a0f-b31f-91168ae4ccb0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Apr 12 16:26:43.645661 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 544/1087] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:26:43.718487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:43.719086 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:43.724935 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:43.725437 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:43.726237 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:43.726883 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:43.759932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:43.760380 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:43.760823 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:43.800504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:43.808015 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-be20b02c-4376-47db-bacf-0efb54f1b889 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.093423 Apr 12 16:26:43.808557 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 544/1088] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:43 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:44.657509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:44.658351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:44.665589 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:44.666373 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:44.667359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:44.667803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:44.823330 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:44.828249 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:44.829434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:44.835331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:44.841396 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:44.841396 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-35309fb5-2dfc-4af6-85e8-2ca7bfafd969 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.188203 Apr 12 16:26:44.841682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:44.841770 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 545/1089] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:44 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:44.846631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:44.846631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:44.846631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:44.880789 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:44.881298 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:44.881959 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:44.925399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:44.933518 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a9ccf0e6-7546-4251-94ff-c55efe69f3c8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.111950 Apr 12 16:26:44.934138 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 545/1090] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:44 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:26:45.860358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:45.861796 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:45.869732 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:45.870745 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:45.872065 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:45.872892 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:45.952091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:45.952884 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:45.964301 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:45.964731 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:45.965731 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:45.966493 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:46.007472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:46.007932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:46.008418 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:46.016459 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:46.025928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:46.027863 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:46.029293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-45fc5711-5f08-43c1-a2b0-fd6bc36eda3c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.173072 Apr 12 16:26:46.030582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 546/1091] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:45 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:46.063854 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:46.072440 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4f4f001e-2761-4f21-897b-bf1760518121 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.125089 Apr 12 16:26:46.073038 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 546/1092] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:45 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:47.048746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:47.049561 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:47.056876 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:47.057485 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:47.058521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:47.058954 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:47.089122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:47.089883 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:47.096655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:47.097148 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:47.097937 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:47.098410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:47.135155 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:47.135612 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:47.136074 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:47.200498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:47.208160 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8070081e-5b9d-46f3-9daa-7e39354c15d6 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.122980 Apr 12 16:26:47.208938 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 547/1093] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:47 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:26:47.240364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:47.248881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:47.250380 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:47.251539 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ec934f42-4bff-479a-bd1e-62119c95ab12 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.206861 Apr 12 16:26:47.252281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 547/1094] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:47 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:48.225775 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:48.226415 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:48.233322 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:48.233777 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:48.234592 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:48.235031 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:48.268473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:48.268958 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:48.269413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:48.270710 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:48.271591 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:48.279603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:48.280301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:48.281355 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:48.281469 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:48.315669 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:48.328347 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-08d127f5-d517-4ae2-a045-b7faeefd345a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.106898 Apr 12 16:26:48.328959 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 548/1095] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:48 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:48.431342 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:48.440174 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:48.441658 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:48.442889 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5553db2f-ddc7-42c9-9411-539efb5cdd9e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.176504 Apr 12 16:26:48.443442 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 548/1096] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:48 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:49.345323 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:49.347175 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:49.354224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:49.354675 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:49.355465 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:49.355902 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:49.390001 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:49.390386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:49.390832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:49.435382 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:49.442849 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-91dc472a-b9ed-451d-a8a2-96477f27fbd3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.101769 Apr 12 16:26:49.443729 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 549/1097] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:49 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:49.460904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:49.461576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:49.468559 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:49.469560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:49.470461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:49.471057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:49.611497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:49.620260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:49.622080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:49.623428 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0afe1ed9-875c-441e-be89-e66b2e6e7a33 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.166448 Apr 12 16:26:49.625823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 549/1098] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:49 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:50.462850 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:50.463446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:50.470458 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:50.470985 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:50.471816 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:50.472255 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:50.505335 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:50.505773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:50.506396 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:50.552905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:50.560950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-72a7e978-1377-45b4-b93a-6efef7dcab23 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.103741 Apr 12 16:26:50.561727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 550/1099] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:50 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:50.650807 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:50.651550 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:50.658712 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:50.659408 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:50.660376 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:50.661016 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:50.811943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:50.830381 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:50.831907 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:50.833074 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2906bf9c-ce71-4982-94ee-b5325fe31338 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.192399 Apr 12 16:26:50.833635 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 550/1100] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:50 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:51.577975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:51.578892 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:51.585955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:51.586539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:51.587398 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:51.587891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:51.621428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:51.622238 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:51.622887 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:51.664980 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:51.674225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2ba6d624-2150-4b5b-9a7f-d74d7f9c1305 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.100235 Apr 12 16:26:51.674815 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 551/1101] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:51 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:51.853027 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:51.854377 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:51.860909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:51.861359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:51.862167 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:51.862866 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:52.016567 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:52.024564 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:52.026095 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:52.027271 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-33a37110-e291-407a-8a40-eb0bae53e330 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.178615 Apr 12 16:26:52.027971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 551/1102] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:51 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:52.691771 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:52.692408 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:52.699608 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:52.700056 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:52.700819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:52.701246 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:52.733316 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:52.733766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:52.734234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:52.774793 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:52.782354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-db3fee7c-6a81-41d1-aa8d-1b18776fe235 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.094472 Apr 12 16:26:52.782924 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 552/1103] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:52 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:53.046069 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:53.046705 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:53.053833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:53.054637 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:53.055461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:53.055909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:53.196513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:53.209359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:53.212197 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:53.214099 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-dc479be6-33c7-4493-b6b8-1f9ed2ae8a6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.171698 Apr 12 16:26:53.214899 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 552/1104] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:53 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:53.804171 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:53.804837 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:53.812063 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:53.812576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:53.813434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:53.813923 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:53.846032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:53.846503 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:53.846953 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lazy-loading 'fault' on Instance uuid dab5e017-4c60-427d-adbd-b1e5c59f96f1 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:53.888478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:53.898682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2a03695d-8960-4a90-8c03-abb346247ec3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 200 len: 1304 microversion: 2.1 time: 0.101290 Apr 12 16:26:53.899433 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 553/1105] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:53 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:54.236747 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:54.237354 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:54.243847 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:54.244297 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:54.245059 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:54.245493 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:54.384004 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:54.392380 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:54.393902 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:54.395100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2e0e7806-572f-410e-aaf2-fd1aef832bd4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.162340 Apr 12 16:26:54.395663 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 553/1106] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:54 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:54.918092 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:54.918825 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: dab5e017-4c60-427d-adbd-b1e5c59f96f1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:54.928089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:54.929133 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:54.930973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:54.931733 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:54.949967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] HTTP exception thrown: Instance dab5e017-4c60-427d-adbd-b1e5c59f96f1 could not be found. Apr 12 16:26:54.950626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Returning 404 to user: Instance dab5e017-4c60-427d-adbd-b1e5c59f96f1 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:26:54.951461 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9d9cf20c-4f8f-45f8-8db6-7e7579871e82 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1" status: 404 len: 111 microversion: 2.1 time: 0.039393 Apr 12 16:26:54.951984 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 554/1107] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:54 2022] GET /compute/v2.1/servers/dab5e017-4c60-427d-adbd-b1e5c59f96f1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:26:55.006808 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1841811221", "imageRef": "670f4a24-6356-4fb0-9bc7-320155435ae8", "flavorRef": "452", "networks": [{"uuid": "4fe30bf7-e15a-43ab-a3df-92a56de425ea"}]}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:55.058561 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] validate_networks() for [('4fe30bf7-e15a-43ab-a3df-92a56de425ea', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:26:55.221271 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-27507e70-159e-490c-b234-317cece6fc99 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:55.221772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-27507e70-159e-490c-b234-317cece6fc99 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:55.228382 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-27507e70-159e-490c-b234-317cece6fc99 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:55.228830 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-27507e70-159e-490c-b234-317cece6fc99 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:55.229603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-27507e70-159e-490c-b234-317cece6fc99 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:55.230062 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-27507e70-159e-490c-b234-317cece6fc99 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:55.309668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-27507e70-159e-490c-b234-317cece6fc99 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'services' on Instance uuid 205dea4d-f2a0-4140-a709-7fdf56fed565 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:26:55.383630 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-27507e70-159e-490c-b234-317cece6fc99 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments/fd0ffed0-97b8-4b43-8b36-8cc905330763" status: 202 len: 0 microversion: 2.1 time: 0.166124 Apr 12 16:26:55.384188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 555/1108] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:26:55 2022] DELETE /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments/fd0ffed0-97b8-4b43-8b36-8cc905330763 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:26:55.392969 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-862104ba-2667-4bb4-ad6b-de004dee002a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:55.394211 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-862104ba-2667-4bb4-ad6b-de004dee002a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:55.400902 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-862104ba-2667-4bb4-ad6b-de004dee002a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:55.401697 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-862104ba-2667-4bb4-ad6b-de004dee002a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:55.402525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-862104ba-2667-4bb4-ad6b-de004dee002a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:55.402946 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-862104ba-2667-4bb4-ad6b-de004dee002a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:55.413428 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:26:55.413951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:26:55.414366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:26:55.414762 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:26:55.415238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:26:55.426970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:55.427344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:55.428662 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:55.429134 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:55.439126 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-862104ba-2667-4bb4-ad6b-de004dee002a tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050300 Apr 12 16:26:55.440197 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 556/1109] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:26:55 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:55.447490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:55.448413 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:55.449028 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Getting quotas for project 5fda4b0004a04e11b47261d4874b63c1. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:26:55.453130 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Getting quotas for user 9b1aa676916c4af0b019ddb174ff4556 and project 5fda4b0004a04e11b47261d4874b63c1. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:26:55.455738 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:55.456266 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:55.457145 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:55.457637 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:55.465005 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:26:55.468605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='670f4a24-6356-4fb0-9bc7-320155435ae8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:26:55.514999 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c3ae5679-0dfc-4e5b-bcbf-733763f66170 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512042 Apr 12 16:26:55.515612 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 554/1110] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:26:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:26:55.526970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8c093247-28dc-4ef3-a2ed-c1b0f1900dd8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:55.527923 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8c093247-28dc-4ef3-a2ed-c1b0f1900dd8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:55.610929 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8c093247-28dc-4ef3-a2ed-c1b0f1900dd8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:55.622704 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8c093247-28dc-4ef3-a2ed-c1b0f1900dd8 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1214 microversion: 2.1 time: 0.099605 Apr 12 16:26:55.623894 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 555/1111] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:55 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:55.636706 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:55.645379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:55.646949 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:55.648132 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-36020f51-bc10-42f1-946c-222fbb637fc9 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.205130 Apr 12 16:26:55.648706 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 557/1112] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:55 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:56.453359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-17898db1-ad4a-4787-9224-6d7c5fa7e71d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:56.454875 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-17898db1-ad4a-4787-9224-6d7c5fa7e71d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:56.465346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-17898db1-ad4a-4787-9224-6d7c5fa7e71d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:56.466028 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-17898db1-ad4a-4787-9224-6d7c5fa7e71d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:56.467009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-17898db1-ad4a-4787-9224-6d7c5fa7e71d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:56.467614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-17898db1-ad4a-4787-9224-6d7c5fa7e71d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:56.498123 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-17898db1-ad4a-4787-9224-6d7c5fa7e71d tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050203 Apr 12 16:26:56.498933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 556/1113] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:26:56 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:56.641754 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0328631c-fa54-4767-b23a-cc057485a8b4 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:56.642730 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0328631c-fa54-4767-b23a-cc057485a8b4 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:56.649760 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0328631c-fa54-4767-b23a-cc057485a8b4 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:56.650419 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0328631c-fa54-4767-b23a-cc057485a8b4 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:56.651276 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0328631c-fa54-4767-b23a-cc057485a8b4 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:56.651819 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0328631c-fa54-4767-b23a-cc057485a8b4 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:56.668322 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:56.669412 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:56.676263 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:56.676946 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:56.678290 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:56.678943 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:56.723033 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0328631c-fa54-4767-b23a-cc057485a8b4 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:56.730809 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0328631c-fa54-4767-b23a-cc057485a8b4 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1272 microversion: 2.1 time: 0.093735 Apr 12 16:26:56.731395 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 558/1114] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:56 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:56.819369 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:56.828713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:56.830293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:56.831586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4cf57e0a-7b83-417b-b241-5d860296c01f tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.168285 Apr 12 16:26:56.832144 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 557/1115] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:56 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:26:57.509485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bc23c433-5c66-474e-bd45-25f21cf88f42 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:57.510511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bc23c433-5c66-474e-bd45-25f21cf88f42 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:57.516696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bc23c433-5c66-474e-bd45-25f21cf88f42 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:57.517133 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bc23c433-5c66-474e-bd45-25f21cf88f42 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:57.517931 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bc23c433-5c66-474e-bd45-25f21cf88f42 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:57.518396 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bc23c433-5c66-474e-bd45-25f21cf88f42 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:57.548077 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bc23c433-5c66-474e-bd45-25f21cf88f42 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Apr 12 16:26:57.548675 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 559/1116] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:26:57 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:57.748721 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-98ee6822-c497-4c3e-bb82-ec380d60621a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:57.749342 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-98ee6822-c497-4c3e-bb82-ec380d60621a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:57.756107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-98ee6822-c497-4c3e-bb82-ec380d60621a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:57.756791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-98ee6822-c497-4c3e-bb82-ec380d60621a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:57.757661 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-98ee6822-c497-4c3e-bb82-ec380d60621a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:57.758135 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-98ee6822-c497-4c3e-bb82-ec380d60621a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:57.788266 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-72ef7c5e-f0cc-4d48-be32-67fe648bb76c req-4e33f7af-02d7-49ff-86c6-6135a01a003f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79e2e80-5679-41bd-aab2-6e740d404eb7", "name": "network-vif-plugged", "status": "completed", "tag": "ea4a126a-a7f5-4e56-928d-bd76dc66e823"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:57.798377 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-72ef7c5e-f0cc-4d48-be32-67fe648bb76c req-4e33f7af-02d7-49ff-86c6-6135a01a003f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:57.799093 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-72ef7c5e-f0cc-4d48-be32-67fe648bb76c req-4e33f7af-02d7-49ff-86c6-6135a01a003f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:57.812950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-72ef7c5e-f0cc-4d48-be32-67fe648bb76c req-4e33f7af-02d7-49ff-86c6-6135a01a003f service nova] Creating event network-vif-plugged:ea4a126a-a7f5-4e56-928d-bd76dc66e823 for instance d79e2e80-5679-41bd-aab2-6e740d404eb7 on hv-cinder-83752 Apr 12 16:26:57.822220 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-72ef7c5e-f0cc-4d48-be32-67fe648bb76c req-4e33f7af-02d7-49ff-86c6-6135a01a003f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038172 Apr 12 16:26:57.823711 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 560/1117] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:26:57.850559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:57.851638 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:57.858945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:57.859850 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:57.860885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:57.861599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:58.287516 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-98ee6822-c497-4c3e-bb82-ec380d60621a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:58.293493 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:58.301645 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-98ee6822-c497-4c3e-bb82-ec380d60621a tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.556761 Apr 12 16:26:58.302275 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 558/1118] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:57 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:58.302903 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:58.304790 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:58.307922 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-6a4b0a52-cd71-47d2-82d2-b56bc1468b74 req-3f62f134-4a08-4992-b762-650d92206550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b29144df-20aa-404b-91b9-56c2aa94b887", "tag": "55530a37-549d-4228-8d3f-3f8436b299a8"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:58.314294 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7783f9cb-5b42-43d8-8841-861b2a6ffd73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.469037 Apr 12 16:26:58.314946 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 561/1119] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:57 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:58.315925 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-6a4b0a52-cd71-47d2-82d2-b56bc1468b74 req-3f62f134-4a08-4992-b762-650d92206550 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:58.316371 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-6a4b0a52-cd71-47d2-82d2-b56bc1468b74 req-3f62f134-4a08-4992-b762-650d92206550 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:58.327834 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-6a4b0a52-cd71-47d2-82d2-b56bc1468b74 req-3f62f134-4a08-4992-b762-650d92206550 service nova] Creating event network-changed:55530a37-549d-4228-8d3f-3f8436b299a8 for instance b29144df-20aa-404b-91b9-56c2aa94b887 on hv-cinder-83752 Apr 12 16:26:58.332953 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-6a4b0a52-cd71-47d2-82d2-b56bc1468b74 req-3f62f134-4a08-4992-b762-650d92206550 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029112 Apr 12 16:26:58.333942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 559/1120] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:58.563522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-205f4aba-21c7-4ad8-aec1-14452c366e63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:58.564908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-205f4aba-21c7-4ad8-aec1-14452c366e63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:58.572399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-205f4aba-21c7-4ad8-aec1-14452c366e63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:58.572853 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-205f4aba-21c7-4ad8-aec1-14452c366e63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:58.573945 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-205f4aba-21c7-4ad8-aec1-14452c366e63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:58.574426 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-205f4aba-21c7-4ad8-aec1-14452c366e63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:58.604611 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-205f4aba-21c7-4ad8-aec1-14452c366e63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Apr 12 16:26:58.605176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 562/1121] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:26:58 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:59.319650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-30509020-aa58-4688-af9c-6c16de3cdd20 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:59.320359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-30509020-aa58-4688-af9c-6c16de3cdd20 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:59.327373 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-30509020-aa58-4688-af9c-6c16de3cdd20 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:59.327831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-30509020-aa58-4688-af9c-6c16de3cdd20 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:59.328653 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-30509020-aa58-4688-af9c-6c16de3cdd20 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:59.329091 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-30509020-aa58-4688-af9c-6c16de3cdd20 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:59.333238 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:59.334348 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:59.342108 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:59.342729 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:59.343637 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:59.344236 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:59.534020 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-30509020-aa58-4688-af9c-6c16de3cdd20 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:59.534997 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:59.543526 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-30509020-aa58-4688-af9c-6c16de3cdd20 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.228757 Apr 12 16:26:59.544161 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 560/1122] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:26:59 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:59.544327 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:59.545909 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:26:59.547127 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7fe80c42-41f9-43fa-9200-9aaf0ce6433e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.217987 Apr 12 16:26:59.547690 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 563/1123] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:26:59 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:26:59.618738 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d866bfe4-8b2d-44e5-a025-e93f9f7d36f5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:59.619659 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d866bfe4-8b2d-44e5-a025-e93f9f7d36f5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:26:59.626535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d866bfe4-8b2d-44e5-a025-e93f9f7d36f5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:59.627032 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d866bfe4-8b2d-44e5-a025-e93f9f7d36f5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:59.627863 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d866bfe4-8b2d-44e5-a025-e93f9f7d36f5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:26:59.628370 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d866bfe4-8b2d-44e5-a025-e93f9f7d36f5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:26:59.659208 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d866bfe4-8b2d-44e5-a025-e93f9f7d36f5 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045787 Apr 12 16:26:59.659796 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 561/1124] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:26:59 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:00.561444 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2571b4e9-e16a-4d4f-8c25-ee83a6babfef tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:00.562064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2571b4e9-e16a-4d4f-8c25-ee83a6babfef tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:00.564816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:00.565425 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:00.569157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2571b4e9-e16a-4d4f-8c25-ee83a6babfef tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:00.569845 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2571b4e9-e16a-4d4f-8c25-ee83a6babfef tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:00.570770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2571b4e9-e16a-4d4f-8c25-ee83a6babfef tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:00.571424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2571b4e9-e16a-4d4f-8c25-ee83a6babfef tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:00.576997 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:00.576997 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:00.576997 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:00.577404 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:00.768839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2571b4e9-e16a-4d4f-8c25-ee83a6babfef tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:00.775138 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:00.777475 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2571b4e9-e16a-4d4f-8c25-ee83a6babfef tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.220254 Apr 12 16:27:00.778081 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 564/1125] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:00 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:00.783511 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-fa97dbe5-ae9c-4ea1-86be-4dc2f488edaf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:00.784431 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-fa97dbe5-ae9c-4ea1-86be-4dc2f488edaf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:00.790541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fa97dbe5-ae9c-4ea1-86be-4dc2f488edaf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:00.790994 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fa97dbe5-ae9c-4ea1-86be-4dc2f488edaf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:00.791835 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fa97dbe5-ae9c-4ea1-86be-4dc2f488edaf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:00.792267 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fa97dbe5-ae9c-4ea1-86be-4dc2f488edaf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:00.792409 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:00.794124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:00.795289 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-22b9b095-2eee-437b-942d-3a18730dc712 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1730 microversion: 2.20 time: 0.234614 Apr 12 16:27:00.795850 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 562/1126] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:27:00 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:27:00.823069 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-fa97dbe5-ae9c-4ea1-86be-4dc2f488edaf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Apr 12 16:27:00.823979 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 565/1127] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:00 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:01.794780 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5c77d881-e9eb-4f98-a26e-b7b00ee9e404 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:01.795379 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5c77d881-e9eb-4f98-a26e-b7b00ee9e404 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:01.801471 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5c77d881-e9eb-4f98-a26e-b7b00ee9e404 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:01.802399 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5c77d881-e9eb-4f98-a26e-b7b00ee9e404 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:01.803361 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5c77d881-e9eb-4f98-a26e-b7b00ee9e404 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:01.803881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5c77d881-e9eb-4f98-a26e-b7b00ee9e404 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:01.814412 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:01.815806 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:01.827182 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:01.827923 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:01.828971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:01.829598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:02.004506 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5c77d881-e9eb-4f98-a26e-b7b00ee9e404 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:02.012352 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5c77d881-e9eb-4f98-a26e-b7b00ee9e404 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.221326 Apr 12 16:27:02.013223 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 563/1128] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:01 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:02.020994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-41f9c83c-6e6c-4dec-b342-41e790fe1bb2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:02.022594 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-41f9c83c-6e6c-4dec-b342-41e790fe1bb2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:02.028637 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-41f9c83c-6e6c-4dec-b342-41e790fe1bb2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:02.029062 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-41f9c83c-6e6c-4dec-b342-41e790fe1bb2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:02.029840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-41f9c83c-6e6c-4dec-b342-41e790fe1bb2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:02.030302 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-41f9c83c-6e6c-4dec-b342-41e790fe1bb2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:02.032054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:02.040314 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:02.041802 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:02.043003 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-158358f9-fbea-4eda-b1a9-95a51e9e7c31 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1717 microversion: 2.20 time: 0.234205 Apr 12 16:27:02.043567 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 566/1129] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:27:01 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1717 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:27:02.061051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-41f9c83c-6e6c-4dec-b342-41e790fe1bb2 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Apr 12 16:27:02.061624 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 564/1130] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:02 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:03.032766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7e3204bc-0a5e-4651-a66a-0c19c87e61b1 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:03.033749 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7e3204bc-0a5e-4651-a66a-0c19c87e61b1 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:03.041656 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7e3204bc-0a5e-4651-a66a-0c19c87e61b1 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:03.042100 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7e3204bc-0a5e-4651-a66a-0c19c87e61b1 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:03.042900 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7e3204bc-0a5e-4651-a66a-0c19c87e61b1 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:03.043339 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7e3204bc-0a5e-4651-a66a-0c19c87e61b1 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:03.073057 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1dbe71aa-1068-415d-8361-cf1bbceb5ce8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:03.074341 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1dbe71aa-1068-415d-8361-cf1bbceb5ce8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:03.081144 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1dbe71aa-1068-415d-8361-cf1bbceb5ce8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:03.081594 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1dbe71aa-1068-415d-8361-cf1bbceb5ce8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:03.082419 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1dbe71aa-1068-415d-8361-cf1bbceb5ce8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:03.082861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1dbe71aa-1068-415d-8361-cf1bbceb5ce8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:03.112930 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1dbe71aa-1068-415d-8361-cf1bbceb5ce8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Apr 12 16:27:03.113512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 565/1131] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:03 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:03.176378 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-7e3204bc-0a5e-4651-a66a-0c19c87e61b1 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:03.184417 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7e3204bc-0a5e-4651-a66a-0c19c87e61b1 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.158266 Apr 12 16:27:03.184982 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 567/1132] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:03 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:04.128753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3e605165-0d57-4a36-974b-9fa00262ee19 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:04.129905 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3e605165-0d57-4a36-974b-9fa00262ee19 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:04.139330 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e605165-0d57-4a36-974b-9fa00262ee19 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.140048 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e605165-0d57-4a36-974b-9fa00262ee19 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:04.141227 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e605165-0d57-4a36-974b-9fa00262ee19 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.141869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e605165-0d57-4a36-974b-9fa00262ee19 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:04.173746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3e605165-0d57-4a36-974b-9fa00262ee19 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051182 Apr 12 16:27:04.174286 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 566/1133] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:04 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:04.202118 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3511bc64-778f-40d3-b5dd-646cf708189d tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:04.202727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3511bc64-778f-40d3-b5dd-646cf708189d tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:04.211122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3511bc64-778f-40d3-b5dd-646cf708189d tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.211555 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3511bc64-778f-40d3-b5dd-646cf708189d tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:04.212316 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3511bc64-778f-40d3-b5dd-646cf708189d tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.212746 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3511bc64-778f-40d3-b5dd-646cf708189d tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:04.350075 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3511bc64-778f-40d3-b5dd-646cf708189d tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:04.357846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3511bc64-778f-40d3-b5dd-646cf708189d tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.159846 Apr 12 16:27:04.358458 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 568/1134] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:04 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:04.736009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1f78a746-d66f-480e-9f7f-218603a311af tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:04.736968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1f78a746-d66f-480e-9f7f-218603a311af tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:04.743831 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1f78a746-d66f-480e-9f7f-218603a311af tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.744281 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1f78a746-d66f-480e-9f7f-218603a311af tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:04.745055 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1f78a746-d66f-480e-9f7f-218603a311af tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.745489 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1f78a746-d66f-480e-9f7f-218603a311af tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:04.775420 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1f78a746-d66f-480e-9f7f-218603a311af tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043440 Apr 12 16:27:04.775971 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 567/1135] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:04 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:04.939864 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-75f3ee88-92b4-437f-a6cc-a176049c9ca4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:04.940354 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-75f3ee88-92b4-437f-a6cc-a176049c9ca4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:04.947304 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75f3ee88-92b4-437f-a6cc-a176049c9ca4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.947930 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75f3ee88-92b4-437f-a6cc-a176049c9ca4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:04.949381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75f3ee88-92b4-437f-a6cc-a176049c9ca4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.949949 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75f3ee88-92b4-437f-a6cc-a176049c9ca4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:04.981626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-75f3ee88-92b4-437f-a6cc-a176049c9ca4 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/f53a86c6-584d-4f89-9176-0d2a9e4442fe" status: 200 len: 194 microversion: 2.1 time: 0.046169 Apr 12 16:27:04.982245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 569/1136] 10.222.0.67 () {58 vars in 1412 bytes} [Tue Apr 12 16:27:04 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/f53a86c6-584d-4f89-9176-0d2a9e4442fe => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:04.992495 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ecd95eb9-b461-4ca7-b987-6cffc31d8d6d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:04.992989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ecd95eb9-b461-4ca7-b987-6cffc31d8d6d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:04.999224 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ecd95eb9-b461-4ca7-b987-6cffc31d8d6d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:04.999671 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ecd95eb9-b461-4ca7-b987-6cffc31d8d6d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:05.000436 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ecd95eb9-b461-4ca7-b987-6cffc31d8d6d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:05.000872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ecd95eb9-b461-4ca7-b987-6cffc31d8d6d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:05.091090 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-ecd95eb9-b461-4ca7-b987-6cffc31d8d6d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lazy-loading 'services' on Instance uuid a43555d2-47fe-4abc-9410-62d4af8a5c8d {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:27:05.170631 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ecd95eb9-b461-4ca7-b987-6cffc31d8d6d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/f53a86c6-584d-4f89-9176-0d2a9e4442fe" status: 202 len: 0 microversion: 2.1 time: 0.182166 Apr 12 16:27:05.171293 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 568/1137] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:27:04 2022] DELETE /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/f53a86c6-584d-4f89-9176-0d2a9e4442fe => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:27:05.186859 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7d8ba2d3-ddf1-4301-8429-ff6aad42f06f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:05.187990 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7d8ba2d3-ddf1-4301-8429-ff6aad42f06f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:05.195618 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d8ba2d3-ddf1-4301-8429-ff6aad42f06f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:05.195926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d8ba2d3-ddf1-4301-8429-ff6aad42f06f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:05.196955 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d8ba2d3-ddf1-4301-8429-ff6aad42f06f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:05.197652 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7d8ba2d3-ddf1-4301-8429-ff6aad42f06f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:05.233768 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7d8ba2d3-ddf1-4301-8429-ff6aad42f06f tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052016 Apr 12 16:27:05.234385 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 570/1138] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:05 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:05.375753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-803dca2b-e4db-43ee-a583-1689a4bcf599 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:05.376725 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-803dca2b-e4db-43ee-a583-1689a4bcf599 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:05.383538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-803dca2b-e4db-43ee-a583-1689a4bcf599 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:05.383987 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-803dca2b-e4db-43ee-a583-1689a4bcf599 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:05.384974 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-803dca2b-e4db-43ee-a583-1689a4bcf599 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:05.385392 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-803dca2b-e4db-43ee-a583-1689a4bcf599 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:05.520912 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-803dca2b-e4db-43ee-a583-1689a4bcf599 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:05.529260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-803dca2b-e4db-43ee-a583-1689a4bcf599 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.157909 Apr 12 16:27:05.529908 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 569/1139] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:05 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:05.927335 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-b86f6a07-9b51-4c99-9a0d-dba3729cab44 req-ee424747-7515-41e2-8f26-b4dcbe947f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29144df-20aa-404b-91b9-56c2aa94b887", "name": "network-vif-plugged", "status": "completed", "tag": "55530a37-549d-4228-8d3f-3f8436b299a8"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:05.936005 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b86f6a07-9b51-4c99-9a0d-dba3729cab44 req-ee424747-7515-41e2-8f26-b4dcbe947f87 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:05.936478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b86f6a07-9b51-4c99-9a0d-dba3729cab44 req-ee424747-7515-41e2-8f26-b4dcbe947f87 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:05.950528 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-b86f6a07-9b51-4c99-9a0d-dba3729cab44 req-ee424747-7515-41e2-8f26-b4dcbe947f87 service nova] Creating event network-vif-plugged:55530a37-549d-4228-8d3f-3f8436b299a8 for instance b29144df-20aa-404b-91b9-56c2aa94b887 on hv-cinder-83752 Apr 12 16:27:05.955602 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-b86f6a07-9b51-4c99-9a0d-dba3729cab44 req-ee424747-7515-41e2-8f26-b4dcbe947f87 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032280 Apr 12 16:27:05.956388 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 571/1140] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:06.245266 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b118ce2c-8f52-4488-ab70-14879a41ce10 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:06.247538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b118ce2c-8f52-4488-ab70-14879a41ce10 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:06.259169 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b118ce2c-8f52-4488-ab70-14879a41ce10 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:06.259615 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b118ce2c-8f52-4488-ab70-14879a41ce10 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:06.261356 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b118ce2c-8f52-4488-ab70-14879a41ce10 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:06.261797 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b118ce2c-8f52-4488-ab70-14879a41ce10 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:06.307056 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b118ce2c-8f52-4488-ab70-14879a41ce10 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065696 Apr 12 16:27:06.308151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 570/1141] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:06 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:27:06.372414 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d03cc917-b366-44e4-8b0c-e18d7cc35785 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:06.373003 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d03cc917-b366-44e4-8b0c-e18d7cc35785 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:06.379950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d03cc917-b366-44e4-8b0c-e18d7cc35785 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:06.380386 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d03cc917-b366-44e4-8b0c-e18d7cc35785 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:06.381171 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d03cc917-b366-44e4-8b0c-e18d7cc35785 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:06.381585 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d03cc917-b366-44e4-8b0c-e18d7cc35785 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:06.405865 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d03cc917-b366-44e4-8b0c-e18d7cc35785 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:27:06.479811 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d03cc917-b366-44e4-8b0c-e18d7cc35785 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 204 len: 0 microversion: 2.1 time: 0.112010 Apr 12 16:27:06.480400 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 572/1142] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:06 2022] DELETE /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:27:06.488574 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2d39f862-d0b3-4fe1-986a-7881bf6ea903 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:06.489197 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2d39f862-d0b3-4fe1-986a-7881bf6ea903 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:06.495633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d39f862-d0b3-4fe1-986a-7881bf6ea903 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:06.496090 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d39f862-d0b3-4fe1-986a-7881bf6ea903 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:06.496870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d39f862-d0b3-4fe1-986a-7881bf6ea903 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:06.497313 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2d39f862-d0b3-4fe1-986a-7881bf6ea903 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:06.546381 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-3a6594d6-102e-4f90-a75e-aa5ce862f043 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:06.547083 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-3a6594d6-102e-4f90-a75e-aa5ce862f043 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:06.553639 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3a6594d6-102e-4f90-a75e-aa5ce862f043 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:06.554091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3a6594d6-102e-4f90-a75e-aa5ce862f043 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:06.554920 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3a6594d6-102e-4f90-a75e-aa5ce862f043 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:06.555403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-3a6594d6-102e-4f90-a75e-aa5ce862f043 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:06.690676 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2d39f862-d0b3-4fe1-986a-7881bf6ea903 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:06.699261 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2d39f862-d0b3-4fe1-986a-7881bf6ea903 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1681 microversion: 2.1 time: 0.214476 Apr 12 16:27:06.699905 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 571/1143] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:06 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:06.719422 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-3a6594d6-102e-4f90-a75e-aa5ce862f043 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:06.728324 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-3a6594d6-102e-4f90-a75e-aa5ce862f043 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.186240 Apr 12 16:27:06.728961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 573/1144] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:06 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:07.720977 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5b544bfd-af26-49ad-b1e8-2f64204821bf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:07.721544 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5b544bfd-af26-49ad-b1e8-2f64204821bf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:07.728979 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b544bfd-af26-49ad-b1e8-2f64204821bf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:07.729439 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b544bfd-af26-49ad-b1e8-2f64204821bf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:07.730231 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b544bfd-af26-49ad-b1e8-2f64204821bf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:07.730681 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b544bfd-af26-49ad-b1e8-2f64204821bf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:07.744926 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f72e0130-dd72-4572-88cf-f5b1c5f84810 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:07.745504 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f72e0130-dd72-4572-88cf-f5b1c5f84810 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:07.752264 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f72e0130-dd72-4572-88cf-f5b1c5f84810 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:07.752717 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f72e0130-dd72-4572-88cf-f5b1c5f84810 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:07.753468 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f72e0130-dd72-4572-88cf-f5b1c5f84810 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:07.753924 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f72e0130-dd72-4572-88cf-f5b1c5f84810 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:07.932365 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5b544bfd-af26-49ad-b1e8-2f64204821bf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:07.940606 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5b544bfd-af26-49ad-b1e8-2f64204821bf tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1681 microversion: 2.1 time: 0.226004 Apr 12 16:27:07.941211 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 572/1145] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:07 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:07.944288 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f72e0130-dd72-4572-88cf-f5b1c5f84810 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:07.956454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f72e0130-dd72-4572-88cf-f5b1c5f84810 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.215164 Apr 12 16:27:07.957347 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 574/1146] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:07 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:27:08.966535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e0c22a74-e3ce-4feb-9265-8663bc7cdaae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:08.967080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-e0c22a74-e3ce-4feb-9265-8663bc7cdaae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:08.974634 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e0c22a74-e3ce-4feb-9265-8663bc7cdaae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:08.975072 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e0c22a74-e3ce-4feb-9265-8663bc7cdaae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:08.975378 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2847ae77-a63c-45ab-9c20-d3e96467ad8b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:08.975845 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e0c22a74-e3ce-4feb-9265-8663bc7cdaae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:08.976002 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2847ae77-a63c-45ab-9c20-d3e96467ad8b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:08.976278 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-e0c22a74-e3ce-4feb-9265-8663bc7cdaae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:08.982485 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2847ae77-a63c-45ab-9c20-d3e96467ad8b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:08.982948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2847ae77-a63c-45ab-9c20-d3e96467ad8b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:08.983724 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2847ae77-a63c-45ab-9c20-d3e96467ad8b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:08.984168 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2847ae77-a63c-45ab-9c20-d3e96467ad8b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:09.168385 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-e0c22a74-e3ce-4feb-9265-8663bc7cdaae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:09.171848 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2847ae77-a63c-45ab-9c20-d3e96467ad8b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:09.176052 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e0c22a74-e3ce-4feb-9265-8663bc7cdaae tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1681 microversion: 2.1 time: 0.215414 Apr 12 16:27:09.176697 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 573/1147] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:08 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:09.180671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2847ae77-a63c-45ab-9c20-d3e96467ad8b tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.209912 Apr 12 16:27:09.181228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 575/1148] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:08 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:09.480992 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cd4d39d0-07d8-4255-96f8-e659e72fbe0d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:09.481493 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-cd4d39d0-07d8-4255-96f8-e659e72fbe0d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:09.487541 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd4d39d0-07d8-4255-96f8-e659e72fbe0d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:09.487995 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd4d39d0-07d8-4255-96f8-e659e72fbe0d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:09.488783 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd4d39d0-07d8-4255-96f8-e659e72fbe0d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:09.489364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd4d39d0-07d8-4255-96f8-e659e72fbe0d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:09.517661 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-cd4d39d0-07d8-4255-96f8-e659e72fbe0d tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/a39363f2-0f6c-4b5a-810c-23922f2d463c" status: 200 len: 194 microversion: 2.1 time: 0.040769 Apr 12 16:27:09.518460 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 574/1149] 10.222.0.67 () {58 vars in 1412 bytes} [Tue Apr 12 16:27:09 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/a39363f2-0f6c-4b5a-810c-23922f2d463c => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:27:09.528629 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8c8ace73-81e6-439b-85fb-34e6027f1d8e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:09.538318 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8c8ace73-81e6-439b-85fb-34e6027f1d8e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:09.544890 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c8ace73-81e6-439b-85fb-34e6027f1d8e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:09.545590 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c8ace73-81e6-439b-85fb-34e6027f1d8e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:09.546479 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c8ace73-81e6-439b-85fb-34e6027f1d8e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:09.546921 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c8ace73-81e6-439b-85fb-34e6027f1d8e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:09.626792 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-8c8ace73-81e6-439b-85fb-34e6027f1d8e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lazy-loading 'services' on Instance uuid a43555d2-47fe-4abc-9410-62d4af8a5c8d {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:27:09.631079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-412086482", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-944614855", "security_groups": [{"name": "tempest-secgroup-smoke-93198052"}], "block_device_mapping_v2": [{"uuid": "98fb6915-a8a7-4f0d-853f-102c7e0e46c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46b7a5ea-cc45-4b33-bcf1-fa2441d5a8b0"}]}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:09.701556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8c8ace73-81e6-439b-85fb-34e6027f1d8e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/a39363f2-0f6c-4b5a-810c-23922f2d463c" status: 202 len: 0 microversion: 2.1 time: 0.176703 Apr 12 16:27:09.702203 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 576/1150] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Apr 12 16:27:09 2022] DELETE /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments/a39363f2-0f6c-4b5a-810c-23922f2d463c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:27:09.752612 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] validate_networks() for [('46b7a5ea-cc45-4b33-bcf1-fa2441d5a8b0', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:27:10.194075 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e5bccdd0-8e35-46e2-83bd-e31a29719364 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:10.194821 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e5bccdd0-8e35-46e2-83bd-e31a29719364 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:10.201844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e5bccdd0-8e35-46e2-83bd-e31a29719364 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:10.202268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e5bccdd0-8e35-46e2-83bd-e31a29719364 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:10.203143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e5bccdd0-8e35-46e2-83bd-e31a29719364 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:10.203526 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e5bccdd0-8e35-46e2-83bd-e31a29719364 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:10.348393 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:27:10.349070 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:27:10.349739 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:27:10.350178 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:27:10.350590 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:27:10.360872 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:10.361319 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:10.362166 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:10.362605 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:10.380202 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for project 9efdb664508148aab946b17b16013559. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:27:10.384689 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Getting quotas for user b72b05bd57f241128f065c0b94663f6d and project 9efdb664508148aab946b17b16013559. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:27:10.432785 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-e5bccdd0-8e35-46e2-83bd-e31a29719364 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:10.442510 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e5bccdd0-8e35-46e2-83bd-e31a29719364 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1681 microversion: 2.1 time: 0.253004 Apr 12 16:27:10.452670 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:27:10.452670 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98fb6915-a8a7-4f0d-853f-102c7e0e46c7',volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:27:10.454547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 577/1151] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:10 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:10.459909 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-26f2c049-146b-403a-bf95-35342774b541 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:10.460520 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-26f2c049-146b-403a-bf95-35342774b541 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:10.467449 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-26f2c049-146b-403a-bf95-35342774b541 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:10.467890 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-26f2c049-146b-403a-bf95-35342774b541 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:10.468820 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-26f2c049-146b-403a-bf95-35342774b541 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:10.469508 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-26f2c049-146b-403a-bf95-35342774b541 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:10.590515 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-418bb932-a96b-4db9-a1fe-265b1b17d501 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.963453 Apr 12 16:27:10.591176 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 575/1152] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:27:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:27:10.601916 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8ca9d606-5e58-4662-979e-6a959e753f48 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:10.602636 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8ca9d606-5e58-4662-979e-6a959e753f48 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:10.700318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8ca9d606-5e58-4662-979e-6a959e753f48 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:10.712965 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8ca9d606-5e58-4662-979e-6a959e753f48 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1093 microversion: 2.1 time: 0.115170 Apr 12 16:27:10.717748 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-26f2c049-146b-403a-bf95-35342774b541 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:10.722450 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 576/1153] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:10 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1093 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:10.744693 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-26f2c049-146b-403a-bf95-35342774b541 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1314 microversion: 2.1 time: 0.288426 Apr 12 16:27:10.746191 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 578/1154] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:10 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:11.131669 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-4616534b-47bc-49cf-ad23-eadf655d18f1 req-04c1a520-62e8-4c8c-a7dd-b36846fbd67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205dea4d-f2a0-4140-a709-7fdf56fed565", "name": "network-vif-deleted", "tag": "ad05cf0d-1109-4515-833c-5a8094f69c9d"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:11.147455 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-4616534b-47bc-49cf-ad23-eadf655d18f1 req-04c1a520-62e8-4c8c-a7dd-b36846fbd67a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.147969 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-4616534b-47bc-49cf-ad23-eadf655d18f1 req-04c1a520-62e8-4c8c-a7dd-b36846fbd67a service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.174536 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-4616534b-47bc-49cf-ad23-eadf655d18f1 req-04c1a520-62e8-4c8c-a7dd-b36846fbd67a service nova] Creating event network-vif-deleted:ad05cf0d-1109-4515-833c-5a8094f69c9d for instance 205dea4d-f2a0-4140-a709-7fdf56fed565 on hv-cinder-83752 Apr 12 16:27:11.180292 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-4616534b-47bc-49cf-ad23-eadf655d18f1 req-04c1a520-62e8-4c8c-a7dd-b36846fbd67a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052347 Apr 12 16:27:11.181019 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 577/1155] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:11.463760 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:11.465128 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:11.472339 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.473304 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.474245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.474932 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.506762 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.507207 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.507655 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lazy-loading 'fault' on Instance uuid 205dea4d-f2a0-4140-a709-7fdf56fed565 {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:27:11.549842 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3db5fc25c5c4478942b471832aff455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8743d75ee3b14874a47f8c5c5054795c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:11.557302 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b30dd6bc-7346-4829-8dfd-b79d37f1b821 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 200 len: 1331 microversion: 2.1 time: 0.100871 Apr 12 16:27:11.557874 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 579/1156] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:11 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:11.740599 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ca046af9-bad2-4245-bce8-34c6f4bff729 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:11.749238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ca046af9-bad2-4245-bce8-34c6f4bff729 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:11.758309 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ca046af9-bad2-4245-bce8-34c6f4bff729 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.759065 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ca046af9-bad2-4245-bce8-34c6f4bff729 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.760155 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ca046af9-bad2-4245-bce8-34c6f4bff729 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.760924 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ca046af9-bad2-4245-bce8-34c6f4bff729 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.762430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-80b57bc5-5d01-47f8-9872-c594a5e862b3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:11.763170 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-80b57bc5-5d01-47f8-9872-c594a5e862b3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:11.778114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-80b57bc5-5d01-47f8-9872-c594a5e862b3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.778540 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-80b57bc5-5d01-47f8-9872-c594a5e862b3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.782241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-80b57bc5-5d01-47f8-9872-c594a5e862b3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.790219 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-80b57bc5-5d01-47f8-9872-c594a5e862b3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.849542 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-ca046af9-bad2-4245-bce8-34c6f4bff729 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:11.867577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ca046af9-bad2-4245-bce8-34c6f4bff729 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1191 microversion: 2.1 time: 0.131416 Apr 12 16:27:11.869534 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 578/1157] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:11 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1191 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:11.937512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b489e45b-3a5f-4811-b486-92b41dcf6933 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:11.939105 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b489e45b-3a5f-4811-b486-92b41dcf6933 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:11.947852 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b489e45b-3a5f-4811-b486-92b41dcf6933 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.950421 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b489e45b-3a5f-4811-b486-92b41dcf6933 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.951597 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b489e45b-3a5f-4811-b486-92b41dcf6933 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:11.952817 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b489e45b-3a5f-4811-b486-92b41dcf6933 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:11.975131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-80b57bc5-5d01-47f8-9872-c594a5e862b3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:11.985583 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-80b57bc5-5d01-47f8-9872-c594a5e862b3 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1498 microversion: 2.1 time: 0.224520 Apr 12 16:27:11.986114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 580/1158] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:11 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1498 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:27:11.999581 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b489e45b-3a5f-4811-b486-92b41dcf6933 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066283 Apr 12 16:27:12.000593 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 579/1159] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:11 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:27:12.118150 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2cbe120f-cb32-406e-8a81-50bd8c110d48 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:12.119472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2cbe120f-cb32-406e-8a81-50bd8c110d48 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:12.126667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2cbe120f-cb32-406e-8a81-50bd8c110d48 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.127068 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2cbe120f-cb32-406e-8a81-50bd8c110d48 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.127857 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2cbe120f-cb32-406e-8a81-50bd8c110d48 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.128305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2cbe120f-cb32-406e-8a81-50bd8c110d48 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.160669 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2cbe120f-cb32-406e-8a81-50bd8c110d48 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046570 Apr 12 16:27:12.161883 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 581/1160] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Apr 12 16:27:12 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:27:12.231067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2f369d7a-6cba-40e1-a811-165e0e855fbd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:12.231668 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2f369d7a-6cba-40e1-a811-165e0e855fbd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:12.238560 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2f369d7a-6cba-40e1-a811-165e0e855fbd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.239207 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2f369d7a-6cba-40e1-a811-165e0e855fbd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.240246 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2f369d7a-6cba-40e1-a811-165e0e855fbd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.240742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2f369d7a-6cba-40e1-a811-165e0e855fbd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.269662 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2f369d7a-6cba-40e1-a811-165e0e855fbd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Going to try to terminate instance {{(pid=117201) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:27:12.391904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2f369d7a-6cba-40e1-a811-165e0e855fbd tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 204 len: 0 microversion: 2.1 time: 0.164001 Apr 12 16:27:12.392716 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 580/1161] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:12 2022] DELETE /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:27:12.401554 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b6fbdaeb-9c89-4b5d-909b-0a06dd80413e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:12.402193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b6fbdaeb-9c89-4b5d-909b-0a06dd80413e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:12.408891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b6fbdaeb-9c89-4b5d-909b-0a06dd80413e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.409336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b6fbdaeb-9c89-4b5d-909b-0a06dd80413e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.410422 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b6fbdaeb-9c89-4b5d-909b-0a06dd80413e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.411022 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b6fbdaeb-9c89-4b5d-909b-0a06dd80413e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.558638 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b6fbdaeb-9c89-4b5d-909b-0a06dd80413e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:12.562532 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-47d7945a-f0ce-4e4b-b62f-717e67d56529 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:12.563120 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-47d7945a-f0ce-4e4b-b62f-717e67d56529 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:12.566277 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b6fbdaeb-9c89-4b5d-909b-0a06dd80413e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1674 microversion: 2.1 time: 0.168746 Apr 12 16:27:12.566846 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 582/1162] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:12 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:27:12.568949 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47d7945a-f0ce-4e4b-b62f-717e67d56529 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.569400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47d7945a-f0ce-4e4b-b62f-717e67d56529 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.570309 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47d7945a-f0ce-4e4b-b62f-717e67d56529 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.570737 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-47d7945a-f0ce-4e4b-b62f-717e67d56529 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.579943 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:12.580550 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:12.587198 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.587727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.588634 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.589829 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.596410 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-47d7945a-f0ce-4e4b-b62f-717e67d56529 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Going to try to terminate instance {{(pid=117201) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:27:12.604371 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 205dea4d-f2a0-4140-a709-7fdf56fed565 could not be found. Apr 12 16:27:12.604947 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 205dea4d-f2a0-4140-a709-7fdf56fed565 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:12.605791 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-7434b89a-5100-4ad4-9ad0-a019132ecd07 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 404 len: 111 microversion: 2.1 time: 0.029639 Apr 12 16:27:12.606561 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 583/1163] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:12 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:27:12.614541 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-44d2f52f-175c-4120-b379-510b6c2c1443 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '.version_select at 0x7f246dcecaf0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:12.633818 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-44d2f52f-175c-4120-b379-510b6c2c1443 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613301615" status: 202 len: 0 microversion: 2.1 time: 0.022817 Apr 12 16:27:12.634439 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 584/1164] 10.222.0.67 () {58 vars in 1220 bytes} [Tue Apr 12 16:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613301615 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:27:12.677036 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-47d7945a-f0ce-4e4b-b62f-717e67d56529 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 204 len: 0 microversion: 2.1 time: 0.118296 Apr 12 16:27:12.677823 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 581/1165] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:12 2022] DELETE /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:27:12.685975 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2079bb83-f5fa-4ea4-9ee1-968764e7f01c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:12.686627 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2079bb83-f5fa-4ea4-9ee1-968764e7f01c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:12.692653 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2079bb83-f5fa-4ea4-9ee1-968764e7f01c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.693112 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2079bb83-f5fa-4ea4-9ee1-968764e7f01c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.694063 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2079bb83-f5fa-4ea4-9ee1-968764e7f01c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.694379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2079bb83-f5fa-4ea4-9ee1-968764e7f01c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.853262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2079bb83-f5fa-4ea4-9ee1-968764e7f01c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:12.863009 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2079bb83-f5fa-4ea4-9ee1-968764e7f01c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1504 microversion: 2.1 time: 0.180854 Apr 12 16:27:12.863798 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 585/1166] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:12 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:12.885536 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a06fa8a9-c886-4600-94a6-5f1e1c7f5a29 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:12.886393 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a06fa8a9-c886-4600-94a6-5f1e1c7f5a29 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:12.892436 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a06fa8a9-c886-4600-94a6-5f1e1c7f5a29 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.892878 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a06fa8a9-c886-4600-94a6-5f1e1c7f5a29 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.893616 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a06fa8a9-c886-4600-94a6-5f1e1c7f5a29 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:12.894101 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a06fa8a9-c886-4600-94a6-5f1e1c7f5a29 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:12.958672 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a06fa8a9-c886-4600-94a6-5f1e1c7f5a29 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:12.966111 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a06fa8a9-c886-4600-94a6-5f1e1c7f5a29 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1209 microversion: 2.1 time: 0.084926 Apr 12 16:27:12.966746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 582/1167] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:12 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:13.588842 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-07053dd2-b384-43fc-b8f0-3a8bd487ab40 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:13.589396 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-07053dd2-b384-43fc-b8f0-3a8bd487ab40 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:13.598499 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07053dd2-b384-43fc-b8f0-3a8bd487ab40 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:13.598971 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07053dd2-b384-43fc-b8f0-3a8bd487ab40 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:13.599847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07053dd2-b384-43fc-b8f0-3a8bd487ab40 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:13.600289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07053dd2-b384-43fc-b8f0-3a8bd487ab40 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:13.735813 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-07053dd2-b384-43fc-b8f0-3a8bd487ab40 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:13.744332 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-07053dd2-b384-43fc-b8f0-3a8bd487ab40 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1674 microversion: 2.1 time: 0.161857 Apr 12 16:27:13.744899 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 586/1168] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:13 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:13.882959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a3aa77a9-0b7e-4a5f-9094-4336240bd229 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:13.883635 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a3aa77a9-0b7e-4a5f-9094-4336240bd229 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:13.891628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3aa77a9-0b7e-4a5f-9094-4336240bd229 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:13.892346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3aa77a9-0b7e-4a5f-9094-4336240bd229 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:13.893177 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3aa77a9-0b7e-4a5f-9094-4336240bd229 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:13.893756 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3aa77a9-0b7e-4a5f-9094-4336240bd229 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:13.985140 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4ea7d4d9-ecd8-40e3-9fff-857c3a5fb5b2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:13.985872 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4ea7d4d9-ecd8-40e3-9fff-857c3a5fb5b2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:13.992342 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4ea7d4d9-ecd8-40e3-9fff-857c3a5fb5b2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:13.992789 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4ea7d4d9-ecd8-40e3-9fff-857c3a5fb5b2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:13.993575 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4ea7d4d9-ecd8-40e3-9fff-857c3a5fb5b2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:13.993985 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4ea7d4d9-ecd8-40e3-9fff-857c3a5fb5b2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:14.028116 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a3aa77a9-0b7e-4a5f-9094-4336240bd229 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:14.035683 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a3aa77a9-0b7e-4a5f-9094-4336240bd229 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1504 microversion: 2.1 time: 0.157627 Apr 12 16:27:14.036610 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 583/1169] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:13 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:14.058937 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-4ea7d4d9-ecd8-40e3-9fff-857c3a5fb5b2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:14.066586 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4ea7d4d9-ecd8-40e3-9fff-857c3a5fb5b2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1209 microversion: 2.1 time: 0.086195 Apr 12 16:27:14.067320 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 587/1170] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:13 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:14.482405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:14.482902 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:14.488973 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:14.489509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:14.490435 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:14.490932 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:14.504244 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 205dea4d-f2a0-4140-a709-7fdf56fed565 could not be found. Apr 12 16:27:14.505043 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 205dea4d-f2a0-4140-a709-7fdf56fed565 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:14.505976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-57e87955-bf0b-4cd4-9bf9-2649de25ecbb tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 404 len: 111 microversion: 2.1 time: 0.027759 Apr 12 16:27:14.506654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 584/1171] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:14 2022] DELETE /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:14.514750 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:14.515445 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 205dea4d-f2a0-4140-a709-7fdf56fed565] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:14.522028 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:14.522512 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:14.523289 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:14.523727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:14.538542 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 205dea4d-f2a0-4140-a709-7fdf56fed565 could not be found. Apr 12 16:27:14.539149 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 205dea4d-f2a0-4140-a709-7fdf56fed565 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:14.539992 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-88c13804-1d11-4897-bd46-624adfd60c61 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565" status: 404 len: 111 microversion: 2.1 time: 0.029192 Apr 12 16:27:14.540553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 588/1172] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:14 2022] GET /compute/v2.1/servers/205dea4d-f2a0-4140-a709-7fdf56fed565 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:14.762403 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a3905b92-de48-450f-a032-5f2dfe76240f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:14.762933 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a3905b92-de48-450f-a032-5f2dfe76240f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:14.769392 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3905b92-de48-450f-a032-5f2dfe76240f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:14.769841 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3905b92-de48-450f-a032-5f2dfe76240f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:14.770806 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3905b92-de48-450f-a032-5f2dfe76240f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:14.771242 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3905b92-de48-450f-a032-5f2dfe76240f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:14.919817 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a3905b92-de48-450f-a032-5f2dfe76240f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:14.929651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a3905b92-de48-450f-a032-5f2dfe76240f tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1674 microversion: 2.1 time: 0.170916 Apr 12 16:27:14.929763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 585/1173] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:14 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:15.057228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f768fd88-1787-4d6c-8c83-95bd07433936 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:15.057820 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f768fd88-1787-4d6c-8c83-95bd07433936 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:15.067538 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f768fd88-1787-4d6c-8c83-95bd07433936 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.068012 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f768fd88-1787-4d6c-8c83-95bd07433936 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.068799 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f768fd88-1787-4d6c-8c83-95bd07433936 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.069278 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f768fd88-1787-4d6c-8c83-95bd07433936 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.084449 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a3971c73-e1c6-45cf-ae25-9df057a4fb2d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:15.085366 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a3971c73-e1c6-45cf-ae25-9df057a4fb2d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:15.091994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3971c73-e1c6-45cf-ae25-9df057a4fb2d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.092693 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3971c73-e1c6-45cf-ae25-9df057a4fb2d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.093478 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3971c73-e1c6-45cf-ae25-9df057a4fb2d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.093976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a3971c73-e1c6-45cf-ae25-9df057a4fb2d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.166253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a3971c73-e1c6-45cf-ae25-9df057a4fb2d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:15.174749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a3971c73-e1c6-45cf-ae25-9df057a4fb2d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1209 microversion: 2.1 time: 0.093978 Apr 12 16:27:15.175654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 586/1174] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:15 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:15.227269 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-f768fd88-1787-4d6c-8c83-95bd07433936 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:15.235268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f768fd88-1787-4d6c-8c83-95bd07433936 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1504 microversion: 2.1 time: 0.185064 Apr 12 16:27:15.235851 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 589/1175] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:15 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:15.696384 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:15.696891 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:15.703680 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.704128 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.704904 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.705344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.718957 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 could not be found. Apr 12 16:27:15.719538 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:15.720361 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-debd0cc6-5815-4979-bc69-7fd6611bdec7 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 404 len: 111 microversion: 2.1 time: 0.028138 Apr 12 16:27:15.720893 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 587/1176] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:15 2022] DELETE /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:15.731114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:15.731950 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: ea521f02-9af9-4bc5-b265-df2e2c2c70f5] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:15.740180 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.740764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.741552 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.741990 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.760717 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 could not be found. Apr 12 16:27:15.761306 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance ea521f02-9af9-4bc5-b265-df2e2c2c70f5 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:15.762175 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-55b4faae-dc44-40a7-b443-1427dc3c4038 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5" status: 404 len: 111 microversion: 2.1 time: 0.036219 Apr 12 16:27:15.762770 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 590/1177] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:15 2022] GET /compute/v2.1/servers/ea521f02-9af9-4bc5-b265-df2e2c2c70f5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:15.783096 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:15.783929 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:15.791304 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.791748 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.792553 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.792984 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.806297 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 06dc15d1-6e23-4515-9016-40ecb0211696 could not be found. Apr 12 16:27:15.806901 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 06dc15d1-6e23-4515-9016-40ecb0211696 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:15.807719 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-40ac99e3-a118-48ce-be92-75f0e6c3db63 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 404 len: 111 microversion: 2.1 time: 0.038275 Apr 12 16:27:15.808273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 588/1178] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:15 2022] DELETE /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:15.818363 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:15.818973 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 06dc15d1-6e23-4515-9016-40ecb0211696] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:15.825769 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.826251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.827019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.827434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.841510 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 06dc15d1-6e23-4515-9016-40ecb0211696 could not be found. Apr 12 16:27:15.842120 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 06dc15d1-6e23-4515-9016-40ecb0211696 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:15.842941 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-f3020cf5-d486-4bfc-b85f-65c3b0f98ea8 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696" status: 404 len: 111 microversion: 2.1 time: 0.028860 Apr 12 16:27:15.843512 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 591/1179] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:15 2022] GET /compute/v2.1/servers/06dc15d1-6e23-4515-9016-40ecb0211696 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:15.947365 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8ab363ba-51c1-4eea-ba55-bef744d9033e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:15.948232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8ab363ba-51c1-4eea-ba55-bef744d9033e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:15.964477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8ab363ba-51c1-4eea-ba55-bef744d9033e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.964477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8ab363ba-51c1-4eea-ba55-bef744d9033e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:15.964477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8ab363ba-51c1-4eea-ba55-bef744d9033e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:15.964477 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8ab363ba-51c1-4eea-ba55-bef744d9033e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:16.099760 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8ab363ba-51c1-4eea-ba55-bef744d9033e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:16.107608 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8ab363ba-51c1-4eea-ba55-bef744d9033e tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1674 microversion: 2.1 time: 0.164407 Apr 12 16:27:16.114624 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 589/1180] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:15 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:16.192761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-cfc9b893-7181-414d-a598-091b5901ce07 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:16.193311 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-cfc9b893-7181-414d-a598-091b5901ce07 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:16.200915 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cfc9b893-7181-414d-a598-091b5901ce07 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:16.201379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cfc9b893-7181-414d-a598-091b5901ce07 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:16.202166 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cfc9b893-7181-414d-a598-091b5901ce07 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:16.202625 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-cfc9b893-7181-414d-a598-091b5901ce07 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:16.252775 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-557fc372-2544-46e2-878e-852041094c0c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:16.253551 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-557fc372-2544-46e2-878e-852041094c0c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:16.260418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-557fc372-2544-46e2-878e-852041094c0c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:16.260944 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-557fc372-2544-46e2-878e-852041094c0c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:16.261976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-557fc372-2544-46e2-878e-852041094c0c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:16.262592 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-557fc372-2544-46e2-878e-852041094c0c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:16.267733 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-cfc9b893-7181-414d-a598-091b5901ce07 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:16.276582 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-cfc9b893-7181-414d-a598-091b5901ce07 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1209 microversion: 2.1 time: 0.087989 Apr 12 16:27:16.277160 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 592/1181] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:16 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:16.458572 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-557fc372-2544-46e2-878e-852041094c0c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:16.466266 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-557fc372-2544-46e2-878e-852041094c0c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1504 microversion: 2.1 time: 0.217481 Apr 12 16:27:16.466906 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 590/1182] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:16 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:17.001224 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:17.002097 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:17.010622 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.011785 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.013208 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.013900 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.032011 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac could not be found. Apr 12 16:27:17.033026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:17.034167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-577ac093-83bc-4feb-a89a-3f600413c079 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 404 len: 111 microversion: 2.1 time: 0.037758 Apr 12 16:27:17.035023 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 593/1183] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:16 2022] DELETE /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:17.046942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:17.048743 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] [instance: 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:17.056708 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.057151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.057922 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.058391 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.073941 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] HTTP exception thrown: Instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac could not be found. Apr 12 16:27:17.074509 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] Returning 404 to user: Instance 7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:17.075350 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-ef7edd80-16b2-4e82-9de1-b39d89f32ca4 tempest-AttachVolumeNegativeTest-1157506990 tempest-AttachVolumeNegativeTest-1157506990-project] 10.222.0.67 "GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac" status: 404 len: 111 microversion: 2.1 time: 0.034900 Apr 12 16:27:17.076147 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 591/1184] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:17 2022] GET /compute/v2.1/servers/7f0d39db-fcb6-41ef-a1f9-e27aa96dbcac => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:27:17.132631 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-03d729e9-c7d2-49f3-8bc8-43ac435cc06b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:17.133266 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-03d729e9-c7d2-49f3-8bc8-43ac435cc06b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:17.144185 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03d729e9-c7d2-49f3-8bc8-43ac435cc06b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.144722 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03d729e9-c7d2-49f3-8bc8-43ac435cc06b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.146162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03d729e9-c7d2-49f3-8bc8-43ac435cc06b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.147176 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-03d729e9-c7d2-49f3-8bc8-43ac435cc06b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.293771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-af1f3615-cf0a-4ec8-a325-8c9fb01bd43c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:17.294545 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-af1f3615-cf0a-4ec8-a325-8c9fb01bd43c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:17.300954 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af1f3615-cf0a-4ec8-a325-8c9fb01bd43c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.301461 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af1f3615-cf0a-4ec8-a325-8c9fb01bd43c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.302753 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af1f3615-cf0a-4ec8-a325-8c9fb01bd43c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.306105 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-03d729e9-c7d2-49f3-8bc8-43ac435cc06b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf30b4421074395b1b70e44bcf6ed10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e274b464718459ea125ef2d5b5003ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:17.309950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-af1f3615-cf0a-4ec8-a325-8c9fb01bd43c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.320668 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-03d729e9-c7d2-49f3-8bc8-43ac435cc06b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 200 len: 1607 microversion: 2.1 time: 0.199533 Apr 12 16:27:17.331951 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 594/1185] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:17 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 1607 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:27:17.415379 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-5da35a2d-e047-43a8-aaf4-24a1e4fee424 req-f22c012d-846f-45c8-843b-fe02a88cdfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43555d2-47fe-4abc-9410-62d4af8a5c8d", "name": "network-vif-deleted", "tag": "a14a2ded-c1a2-48f4-8a82-e95849ab2429"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:17.424157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-5da35a2d-e047-43a8-aaf4-24a1e4fee424 req-f22c012d-846f-45c8-843b-fe02a88cdfb4 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.424883 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-5da35a2d-e047-43a8-aaf4-24a1e4fee424 req-f22c012d-846f-45c8-843b-fe02a88cdfb4 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.437492 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-5da35a2d-e047-43a8-aaf4-24a1e4fee424 req-f22c012d-846f-45c8-843b-fe02a88cdfb4 service nova] Creating event network-vif-deleted:a14a2ded-c1a2-48f4-8a82-e95849ab2429 for instance a43555d2-47fe-4abc-9410-62d4af8a5c8d on hv-cinder-83752 Apr 12 16:27:17.443615 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-5da35a2d-e047-43a8-aaf4-24a1e4fee424 req-f22c012d-846f-45c8-843b-fe02a88cdfb4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031874 Apr 12 16:27:17.445157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 595/1186] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:17.487055 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2e7a5ef8-048a-42c7-93a0-537a14db1216 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:17.487887 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2e7a5ef8-048a-42c7-93a0-537a14db1216 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:17.495803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-af1f3615-cf0a-4ec8-a325-8c9fb01bd43c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:17.503421 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2e7a5ef8-048a-42c7-93a0-537a14db1216 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.505589 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2e7a5ef8-048a-42c7-93a0-537a14db1216 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.507396 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2e7a5ef8-048a-42c7-93a0-537a14db1216 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:17.510245 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-af1f3615-cf0a-4ec8-a325-8c9fb01bd43c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1197 microversion: 2.1 time: 0.217790 Apr 12 16:27:17.511253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 592/1187] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:17 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:17.513368 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2e7a5ef8-048a-42c7-93a0-537a14db1216 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:17.864614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2e7a5ef8-048a-42c7-93a0-537a14db1216 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1aa676916c4af0b019ddb174ff4556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fda4b0004a04e11b47261d4874b63c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:17.878229 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2e7a5ef8-048a-42c7-93a0-537a14db1216 tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 200 len: 1504 microversion: 2.1 time: 0.397919 Apr 12 16:27:17.884579 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 596/1188] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:17 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:27:18.090225 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-ef3c15f4-0f3b-4541-bb4f-6c36c9c115d8 req-82f91d69-3413-4db5-8a3b-22b10e241150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29144df-20aa-404b-91b9-56c2aa94b887", "name": "network-vif-deleted", "tag": "55530a37-549d-4228-8d3f-3f8436b299a8"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:18.108233 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-ef3c15f4-0f3b-4541-bb4f-6c36c9c115d8 req-82f91d69-3413-4db5-8a3b-22b10e241150 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:18.111254 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-ef3c15f4-0f3b-4541-bb4f-6c36c9c115d8 req-82f91d69-3413-4db5-8a3b-22b10e241150 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:18.125351 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-ef3c15f4-0f3b-4541-bb4f-6c36c9c115d8 req-82f91d69-3413-4db5-8a3b-22b10e241150 service nova] Creating event network-vif-deleted:55530a37-549d-4228-8d3f-3f8436b299a8 for instance b29144df-20aa-404b-91b9-56c2aa94b887 on hv-cinder-83752 Apr 12 16:27:18.132660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-ef3c15f4-0f3b-4541-bb4f-6c36c9c115d8 req-82f91d69-3413-4db5-8a3b-22b10e241150 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046206 Apr 12 16:27:18.133969 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 593/1189] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:18.339414 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:18.340226 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:18.347692 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:18.348317 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:18.349438 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:18.350000 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:18.364836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] HTTP exception thrown: Instance a43555d2-47fe-4abc-9410-62d4af8a5c8d could not be found. Apr 12 16:27:18.365423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Returning 404 to user: Instance a43555d2-47fe-4abc-9410-62d4af8a5c8d could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:18.366295 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d1dbeab1-1e9a-4321-8bd3-9c1af0480a94 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 404 len: 111 microversion: 2.1 time: 0.031132 Apr 12 16:27:18.367484 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 597/1190] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:18 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:18.376358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-63e1667e-0c06-4f04-b5c1-64b1b3f90922 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '.version_select at 0x7f246de6a310>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:18.396614 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-63e1667e-0c06-4f04-b5c1-64b1b3f90922 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024620547" status: 202 len: 0 microversion: 2.1 time: 0.024383 Apr 12 16:27:18.398006 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 594/1191] 10.222.0.67 () {58 vars in 1220 bytes} [Tue Apr 12 16:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024620547 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:27:18.528027 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-75d66f0e-6921-4293-a605-584ca529b363 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:18.529167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-75d66f0e-6921-4293-a605-584ca529b363 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:18.550125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75d66f0e-6921-4293-a605-584ca529b363 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:18.550593 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75d66f0e-6921-4293-a605-584ca529b363 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:18.551449 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75d66f0e-6921-4293-a605-584ca529b363 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:18.554598 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-75d66f0e-6921-4293-a605-584ca529b363 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:18.879757 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-75d66f0e-6921-4293-a605-584ca529b363 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:18.888543 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-75d66f0e-6921-4293-a605-584ca529b363 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.364685 Apr 12 16:27:18.889811 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 598/1192] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:18 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:18.899681 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:18.900386 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] [instance: b29144df-20aa-404b-91b9-56c2aa94b887] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:18.906636 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:18.907082 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:18.907870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:18.908279 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:18.923152 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] HTTP exception thrown: Instance b29144df-20aa-404b-91b9-56c2aa94b887 could not be found. Apr 12 16:27:18.923950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] Returning 404 to user: Instance b29144df-20aa-404b-91b9-56c2aa94b887 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:18.924945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3e418413-130a-491b-bf59-523df5d7567c tempest-VolumesActionsTest-1846209072 tempest-VolumesActionsTest-1846209072-project] 10.222.0.67 "GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887" status: 404 len: 111 microversion: 2.1 time: 0.029877 Apr 12 16:27:18.925651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 595/1193] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:18 2022] GET /compute/v2.1/servers/b29144df-20aa-404b-91b9-56c2aa94b887 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:27:19.906666 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-79ac4e97-19ac-475c-aa9a-402068e3fa1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:19.907671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-79ac4e97-19ac-475c-aa9a-402068e3fa1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:19.915424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-79ac4e97-19ac-475c-aa9a-402068e3fa1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:19.915876 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-79ac4e97-19ac-475c-aa9a-402068e3fa1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:19.916669 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-79ac4e97-19ac-475c-aa9a-402068e3fa1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:19.917104 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-79ac4e97-19ac-475c-aa9a-402068e3fa1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:20.152314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-2b164930-906b-470c-a797-aca45c15a71a req-f6036f5e-a505-4956-9d49-ec7d3a0520ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b", "tag": "d861fdfc-9161-44f1-a933-dd10d7398a1e"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:20.161333 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2b164930-906b-470c-a797-aca45c15a71a req-f6036f5e-a505-4956-9d49-ec7d3a0520ea service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:20.161772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-2b164930-906b-470c-a797-aca45c15a71a req-f6036f5e-a505-4956-9d49-ec7d3a0520ea service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:20.173506 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-2b164930-906b-470c-a797-aca45c15a71a req-f6036f5e-a505-4956-9d49-ec7d3a0520ea service nova] Creating event network-changed:d861fdfc-9161-44f1-a933-dd10d7398a1e for instance 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b on hv-cinder-83752 Apr 12 16:27:20.178811 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-2b164930-906b-470c-a797-aca45c15a71a req-f6036f5e-a505-4956-9d49-ec7d3a0520ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030208 Apr 12 16:27:20.179593 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 596/1194] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:20.237797 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-79ac4e97-19ac-475c-aa9a-402068e3fa1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:20.245839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-79ac4e97-19ac-475c-aa9a-402068e3fa1a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.343271 Apr 12 16:27:20.246448 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 599/1195] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:19 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:21.264675 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-73b2aa6e-8ad8-4b3e-bcd6-d89cbf62363c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:21.266247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-73b2aa6e-8ad8-4b3e-bcd6-d89cbf62363c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:21.273817 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73b2aa6e-8ad8-4b3e-bcd6-d89cbf62363c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:21.274452 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73b2aa6e-8ad8-4b3e-bcd6-d89cbf62363c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:21.275381 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73b2aa6e-8ad8-4b3e-bcd6-d89cbf62363c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:21.276067 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73b2aa6e-8ad8-4b3e-bcd6-d89cbf62363c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:21.425990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-73b2aa6e-8ad8-4b3e-bcd6-d89cbf62363c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:21.441819 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-73b2aa6e-8ad8-4b3e-bcd6-d89cbf62363c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.175605 Apr 12 16:27:21.441819 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 597/1196] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:21 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:22.452225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a10a1727-8f49-4d93-988e-ce3c64a579af tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:22.452847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a10a1727-8f49-4d93-988e-ce3c64a579af tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:22.459640 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a10a1727-8f49-4d93-988e-ce3c64a579af tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:22.460090 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a10a1727-8f49-4d93-988e-ce3c64a579af tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:22.460870 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a10a1727-8f49-4d93-988e-ce3c64a579af tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:22.461495 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a10a1727-8f49-4d93-988e-ce3c64a579af tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:22.611290 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a10a1727-8f49-4d93-988e-ce3c64a579af tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:22.620257 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a10a1727-8f49-4d93-988e-ce3c64a579af tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.171775 Apr 12 16:27:22.620982 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 600/1197] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:22 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:23.637283 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a84c2bf2-72d3-4d88-bde7-8578e10e193c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:23.638400 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a84c2bf2-72d3-4d88-bde7-8578e10e193c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:23.646402 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a84c2bf2-72d3-4d88-bde7-8578e10e193c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:23.646940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a84c2bf2-72d3-4d88-bde7-8578e10e193c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:23.647851 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a84c2bf2-72d3-4d88-bde7-8578e10e193c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:23.648397 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a84c2bf2-72d3-4d88-bde7-8578e10e193c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:23.877307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a84c2bf2-72d3-4d88-bde7-8578e10e193c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:23.885108 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a84c2bf2-72d3-4d88-bde7-8578e10e193c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.252200 Apr 12 16:27:23.885652 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 598/1198] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:23 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:24.577824 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:24.578436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:24.585426 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:24.585937 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:24.586821 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:24.588055 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:24.606644 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] HTTP exception thrown: Instance a43555d2-47fe-4abc-9410-62d4af8a5c8d could not be found. Apr 12 16:27:24.607502 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Returning 404 to user: Instance a43555d2-47fe-4abc-9410-62d4af8a5c8d could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:24.608467 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-36449b3a-1e9a-49f3-a953-028d68227f05 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 404 len: 111 microversion: 2.1 time: 0.035559 Apr 12 16:27:24.609157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 601/1199] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:24 2022] DELETE /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:24.619674 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:24.620796 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: a43555d2-47fe-4abc-9410-62d4af8a5c8d] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:24.627720 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:24.628374 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:24.629480 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:24.630871 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:24.646588 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] HTTP exception thrown: Instance a43555d2-47fe-4abc-9410-62d4af8a5c8d could not be found. Apr 12 16:27:24.647304 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Returning 404 to user: Instance a43555d2-47fe-4abc-9410-62d4af8a5c8d could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:24.648066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c0957af6-63dc-4e7e-b20c-0833ba1d9b7b tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d" status: 404 len: 111 microversion: 2.1 time: 0.033670 Apr 12 16:27:24.648932 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 599/1200] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:24 2022] GET /compute/v2.1/servers/a43555d2-47fe-4abc-9410-62d4af8a5c8d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:24.902315 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ae898309-6959-4c15-8e55-d35e647e81a0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:24.903078 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ae898309-6959-4c15-8e55-d35e647e81a0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:24.916538 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae898309-6959-4c15-8e55-d35e647e81a0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:24.917147 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae898309-6959-4c15-8e55-d35e647e81a0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:24.917991 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae898309-6959-4c15-8e55-d35e647e81a0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:24.918678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ae898309-6959-4c15-8e55-d35e647e81a0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:25.109188 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ae898309-6959-4c15-8e55-d35e647e81a0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:25.122085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ae898309-6959-4c15-8e55-d35e647e81a0 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.222706 Apr 12 16:27:25.122783 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 602/1201] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:24 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:25.813749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:25.814613 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:25.823072 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:25.823778 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:25.824994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:25.825612 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:25.842150 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] HTTP exception thrown: Instance 23749e20-689d-41b3-b798-49c86d90ae20 could not be found. Apr 12 16:27:25.843371 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Returning 404 to user: Instance 23749e20-689d-41b3-b798-49c86d90ae20 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:25.844577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-73a14b86-e6da-4d56-ae7b-9b64d9bbe9a8 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "DELETE /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 404 len: 111 microversion: 2.1 time: 0.036158 Apr 12 16:27:25.845815 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 600/1202] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:27:25 2022] DELETE /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:25.855045 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:25.855844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] [instance: 23749e20-689d-41b3-b798-49c86d90ae20] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:25.864618 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:25.865076 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:25.865898 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:25.866606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:25.883243 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] HTTP exception thrown: Instance 23749e20-689d-41b3-b798-49c86d90ae20 could not be found. Apr 12 16:27:25.884490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] Returning 404 to user: Instance 23749e20-689d-41b3-b798-49c86d90ae20 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:25.885772 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-acdc6b7a-965e-4499-bb70-233f0638f026 tempest-AttachVolumeTestJSON-720595955 tempest-AttachVolumeTestJSON-720595955-project] 10.222.0.67 "GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20" status: 404 len: 111 microversion: 2.1 time: 0.035462 Apr 12 16:27:25.886566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 603/1203] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:25 2022] GET /compute/v2.1/servers/23749e20-689d-41b3-b798-49c86d90ae20 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:26.140123 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-402c0e68-005d-4495-9c2d-de7af36889a6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:26.140759 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-402c0e68-005d-4495-9c2d-de7af36889a6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:26.150122 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-402c0e68-005d-4495-9c2d-de7af36889a6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:26.151059 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-402c0e68-005d-4495-9c2d-de7af36889a6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:26.152080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-402c0e68-005d-4495-9c2d-de7af36889a6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:26.152515 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-402c0e68-005d-4495-9c2d-de7af36889a6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:26.373784 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-402c0e68-005d-4495-9c2d-de7af36889a6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:26.384148 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-402c0e68-005d-4495-9c2d-de7af36889a6 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.248008 Apr 12 16:27:26.385439 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 601/1204] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:26 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:27.405987 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b068a7d1-b3ff-4411-9fde-da9f0b8d35b1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:27.407762 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b068a7d1-b3ff-4411-9fde-da9f0b8d35b1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:27.424058 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b068a7d1-b3ff-4411-9fde-da9f0b8d35b1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:27.424534 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b068a7d1-b3ff-4411-9fde-da9f0b8d35b1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:27.425352 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b068a7d1-b3ff-4411-9fde-da9f0b8d35b1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:27.425933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b068a7d1-b3ff-4411-9fde-da9f0b8d35b1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:27.839738 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b068a7d1-b3ff-4411-9fde-da9f0b8d35b1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:27.857175 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b068a7d1-b3ff-4411-9fde-da9f0b8d35b1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.456046 Apr 12 16:27:27.858141 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 604/1205] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:27 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:28.874633 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a2c3200f-2733-4f70-a734-a73ad9f24632 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:28.876040 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a2c3200f-2733-4f70-a734-a73ad9f24632 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:28.883124 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2c3200f-2733-4f70-a734-a73ad9f24632 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:28.883870 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2c3200f-2733-4f70-a734-a73ad9f24632 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:28.884805 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2c3200f-2733-4f70-a734-a73ad9f24632 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:28.885384 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a2c3200f-2733-4f70-a734-a73ad9f24632 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:29.344229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a2c3200f-2733-4f70-a734-a73ad9f24632 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:29.352748 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a2c3200f-2733-4f70-a734-a73ad9f24632 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.482012 Apr 12 16:27:29.354058 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 602/1206] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:28 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:30.369927 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b81220da-83de-4e84-8cf5-8a387ac6fbef tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:30.370946 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b81220da-83de-4e84-8cf5-8a387ac6fbef tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:30.383098 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b81220da-83de-4e84-8cf5-8a387ac6fbef tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:30.383615 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b81220da-83de-4e84-8cf5-8a387ac6fbef tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:30.384524 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b81220da-83de-4e84-8cf5-8a387ac6fbef tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:30.386977 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b81220da-83de-4e84-8cf5-8a387ac6fbef tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:30.652536 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b81220da-83de-4e84-8cf5-8a387ac6fbef tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:30.666085 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b81220da-83de-4e84-8cf5-8a387ac6fbef tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.299975 Apr 12 16:27:30.669835 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 605/1207] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:30 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:31.686491 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-596a9d4d-2d4c-40ef-aea1-f8c0314682c4 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:31.687079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-596a9d4d-2d4c-40ef-aea1-f8c0314682c4 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:31.694928 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-596a9d4d-2d4c-40ef-aea1-f8c0314682c4 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:31.695798 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-596a9d4d-2d4c-40ef-aea1-f8c0314682c4 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:31.697458 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-596a9d4d-2d4c-40ef-aea1-f8c0314682c4 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:31.697926 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-596a9d4d-2d4c-40ef-aea1-f8c0314682c4 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:31.900513 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-596a9d4d-2d4c-40ef-aea1-f8c0314682c4 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:31.928040 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-596a9d4d-2d4c-40ef-aea1-f8c0314682c4 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.245745 Apr 12 16:27:31.929216 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 603/1208] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:31 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:32.946307 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d2fde98d-acaa-4adf-841a-a623820b988c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:32.946911 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d2fde98d-acaa-4adf-841a-a623820b988c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:32.955610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d2fde98d-acaa-4adf-841a-a623820b988c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:32.956128 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d2fde98d-acaa-4adf-841a-a623820b988c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:32.957228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d2fde98d-acaa-4adf-841a-a623820b988c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:32.957814 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d2fde98d-acaa-4adf-841a-a623820b988c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:33.246092 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d2fde98d-acaa-4adf-841a-a623820b988c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:33.262610 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d2fde98d-acaa-4adf-841a-a623820b988c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.314526 Apr 12 16:27:33.263322 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 606/1209] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:32 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:34.150473 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-1d051673-9b1e-4b33-86b7-2e2aff47e5bf req-812c057f-5ae0-426d-b45d-3b2a386d10f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b", "name": "network-vif-plugged", "status": "completed", "tag": "d861fdfc-9161-44f1-a933-dd10d7398a1e"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:34.163141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-1d051673-9b1e-4b33-86b7-2e2aff47e5bf req-812c057f-5ae0-426d-b45d-3b2a386d10f3 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:34.171331 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-1d051673-9b1e-4b33-86b7-2e2aff47e5bf req-812c057f-5ae0-426d-b45d-3b2a386d10f3 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:34.205080 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-1d051673-9b1e-4b33-86b7-2e2aff47e5bf req-812c057f-5ae0-426d-b45d-3b2a386d10f3 service nova] Creating event network-vif-plugged:d861fdfc-9161-44f1-a933-dd10d7398a1e for instance 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b on hv-cinder-83752 Apr 12 16:27:34.213358 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-1d051673-9b1e-4b33-86b7-2e2aff47e5bf req-812c057f-5ae0-426d-b45d-3b2a386d10f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066798 Apr 12 16:27:34.214839 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 604/1210] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:34.280244 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a771fd5c-aa18-4b6b-85ee-646548d9e89f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:34.280964 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a771fd5c-aa18-4b6b-85ee-646548d9e89f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:34.289116 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a771fd5c-aa18-4b6b-85ee-646548d9e89f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:34.289761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a771fd5c-aa18-4b6b-85ee-646548d9e89f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:34.290802 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a771fd5c-aa18-4b6b-85ee-646548d9e89f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:34.291787 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a771fd5c-aa18-4b6b-85ee-646548d9e89f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:34.506142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a771fd5c-aa18-4b6b-85ee-646548d9e89f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:34.518031 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a771fd5c-aa18-4b6b-85ee-646548d9e89f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.241339 Apr 12 16:27:34.518673 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 607/1211] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:34 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:35.537849 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-efa3f7f6-4fd5-4665-a5c6-380d2df06817 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:35.538583 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-efa3f7f6-4fd5-4665-a5c6-380d2df06817 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:35.554878 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-efa3f7f6-4fd5-4665-a5c6-380d2df06817 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:35.558742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-efa3f7f6-4fd5-4665-a5c6-380d2df06817 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:35.559814 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-efa3f7f6-4fd5-4665-a5c6-380d2df06817 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:35.560405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-efa3f7f6-4fd5-4665-a5c6-380d2df06817 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:35.775897 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-efa3f7f6-4fd5-4665-a5c6-380d2df06817 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:35.788624 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-efa3f7f6-4fd5-4665-a5c6-380d2df06817 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1263 microversion: 2.1 time: 0.256331 Apr 12 16:27:35.789321 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 605/1212] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:35 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1263 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:36.808445 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-9c149c52-08d8-41f1-ac94-c26ba119527d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:36.812609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-9c149c52-08d8-41f1-ac94-c26ba119527d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:36.817839 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9c149c52-08d8-41f1-ac94-c26ba119527d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:36.818453 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9c149c52-08d8-41f1-ac94-c26ba119527d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:36.819505 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9c149c52-08d8-41f1-ac94-c26ba119527d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:36.820040 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-9c149c52-08d8-41f1-ac94-c26ba119527d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:36.998512 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-9c149c52-08d8-41f1-ac94-c26ba119527d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:37.010688 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-9c149c52-08d8-41f1-ac94-c26ba119527d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1451 microversion: 2.1 time: 0.206773 Apr 12 16:27:37.011389 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 608/1213] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:36 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1451 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:37.034209 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-56053385-b54a-437b-9f0b-44457b63293e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:37.036952 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-56053385-b54a-437b-9f0b-44457b63293e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:37.046521 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56053385-b54a-437b-9f0b-44457b63293e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:37.047445 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56053385-b54a-437b-9f0b-44457b63293e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:37.048337 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56053385-b54a-437b-9f0b-44457b63293e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:37.048866 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-56053385-b54a-437b-9f0b-44457b63293e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:37.226790 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-56053385-b54a-437b-9f0b-44457b63293e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:37.244091 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-56053385-b54a-437b-9f0b-44457b63293e tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1451 microversion: 2.1 time: 0.211117 Apr 12 16:27:37.245582 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 606/1214] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:27:37 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1451 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:40.429438 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-b137b98c-1c8c-4510-9013-f354368645b6 req-6099f40c-c54b-4916-b35e-c8ba5317e4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b", "tag": "d861fdfc-9161-44f1-a933-dd10d7398a1e"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:40.470783 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b137b98c-1c8c-4510-9013-f354368645b6 req-6099f40c-c54b-4916-b35e-c8ba5317e4ce service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:40.471251 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b137b98c-1c8c-4510-9013-f354368645b6 req-6099f40c-c54b-4916-b35e-c8ba5317e4ce service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:40.509556 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-b137b98c-1c8c-4510-9013-f354368645b6 req-6099f40c-c54b-4916-b35e-c8ba5317e4ce service nova] Creating event network-changed:d861fdfc-9161-44f1-a933-dd10d7398a1e for instance 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b on hv-cinder-83752 Apr 12 16:27:40.528776 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-b137b98c-1c8c-4510-9013-f354368645b6 req-6099f40c-c54b-4916-b35e-c8ba5317e4ce service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103389 Apr 12 16:27:40.529746 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 609/1215] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:49.927266 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0b6a090f-8ae5-49ce-bb6d-9ebd4c66c9bc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:49.928695 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0b6a090f-8ae5-49ce-bb6d-9ebd4c66c9bc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:49.936639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b6a090f-8ae5-49ce-bb6d-9ebd4c66c9bc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:49.937393 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b6a090f-8ae5-49ce-bb6d-9ebd4c66c9bc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:49.938243 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b6a090f-8ae5-49ce-bb6d-9ebd4c66c9bc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:49.939066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0b6a090f-8ae5-49ce-bb6d-9ebd4c66c9bc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:49.985654 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0b6a090f-8ae5-49ce-bb6d-9ebd4c66c9bc tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063355 Apr 12 16:27:49.989441 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 607/1216] 10.222.0.67 () {60 vars in 1342 bytes} [Tue Apr 12 16:27:49 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:50.045454 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-652780b4-5f0c-4b73-b1f0-f2b00611107c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:50.046089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-652780b4-5f0c-4b73-b1f0-f2b00611107c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:50.054617 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-652780b4-5f0c-4b73-b1f0-f2b00611107c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:50.055079 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-652780b4-5f0c-4b73-b1f0-f2b00611107c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:50.055867 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-652780b4-5f0c-4b73-b1f0-f2b00611107c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:50.056316 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-652780b4-5f0c-4b73-b1f0-f2b00611107c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:50.082928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-652780b4-5f0c-4b73-b1f0-f2b00611107c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:27:50.170885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-652780b4-5f0c-4b73-b1f0-f2b00611107c tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 204 len: 0 microversion: 2.20 time: 0.129876 Apr 12 16:27:50.171491 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 610/1217] 10.222.0.67 () {60 vars in 1279 bytes} [Tue Apr 12 16:27:50 2022] DELETE /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:27:50.180945 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:50.181568 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:50.188698 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:50.189494 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:50.190736 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:50.191399 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:50.335891 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:50.344378 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:50.346607 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:50.347802 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1575c62e-c0fc-431c-a489-17170a3bb6cd tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.171546 Apr 12 16:27:50.348374 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 608/1218] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:27:50 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:27:51.367867 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:51.369434 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:51.376183 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:51.376689 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:51.377622 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:51.378228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:51.517450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:51.525925 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:51.527450 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:51.528830 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-8c9b9580-d51a-4edd-814b-3068187b8d6d tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.165199 Apr 12 16:27:51.529446 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 611/1219] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:27:51 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:27:52.548072 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:52.548691 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:52.554989 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:52.555437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:52.556683 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:52.557194 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:52.812222 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:52.820772 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:52.822783 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:52.824203 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3037d35a-2b8b-467e-8879-7c20095699f2 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1723 microversion: 2.20 time: 0.280212 Apr 12 16:27:52.824934 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 609/1220] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:27:52 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:27:53.250702 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-ab7b51b6-5f3f-44d6-ba0a-fe7d188b631f req-be29dc0f-0a84-481e-80ab-b14d9ed065a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79e2e80-5679-41bd-aab2-6e740d404eb7", "name": "network-vif-deleted", "tag": "ea4a126a-a7f5-4e56-928d-bd76dc66e823"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:53.264089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-ab7b51b6-5f3f-44d6-ba0a-fe7d188b631f req-be29dc0f-0a84-481e-80ab-b14d9ed065a0 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:53.264522 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-ab7b51b6-5f3f-44d6-ba0a-fe7d188b631f req-be29dc0f-0a84-481e-80ab-b14d9ed065a0 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:53.292273 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-ab7b51b6-5f3f-44d6-ba0a-fe7d188b631f req-be29dc0f-0a84-481e-80ab-b14d9ed065a0 service nova] Creating event network-vif-deleted:ea4a126a-a7f5-4e56-928d-bd76dc66e823 for instance d79e2e80-5679-41bd-aab2-6e740d404eb7 on hv-cinder-83752 Apr 12 16:27:53.298245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-ab7b51b6-5f3f-44d6-ba0a-fe7d188b631f req-be29dc0f-0a84-481e-80ab-b14d9ed065a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056826 Apr 12 16:27:53.299164 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 612/1221] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:53.842680 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:53.844858 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:53.854869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:53.855533 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:53.856626 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:53.857210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:53.896482 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:53.897365 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:53.898401 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lazy-loading 'fault' on Instance uuid d79e2e80-5679-41bd-aab2-6e740d404eb7 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:27:53.951044 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:53.958990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:53.961733 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1435d492ce4751a0b4eac7558ad9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e8e703a32d4ac4be28bb7018de850f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:27:53.963101 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5b476997-a461-4ec8-a6dc-921558990f8e tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 200 len: 1370 microversion: 2.20 time: 0.124347 Apr 12 16:27:53.975396 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 610/1222] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:27:53 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 1370 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:27:54.983992 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:54.984703 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:54.991264 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:54.991719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:54.992908 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:54.993056 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:55.007918 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] HTTP exception thrown: Instance d79e2e80-5679-41bd-aab2-6e740d404eb7 could not be found. Apr 12 16:27:55.008803 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Returning 404 to user: Instance d79e2e80-5679-41bd-aab2-6e740d404eb7 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:55.009940 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e007bf8a-7346-4675-ab7d-309a9dcdef06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 404 len: 111 microversion: 2.20 time: 0.030707 Apr 12 16:27:55.014373 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 613/1223] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:27:54 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:27:55.023280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-e9e56821-f63b-4aec-a210-be172dbed8c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '.version_select at 0x7f246dbf5940>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:55.042581 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-e9e56821-f63b-4aec-a210-be172dbed8c3 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327994734" status: 204 len: 0 microversion: 2.20 time: 0.022634 Apr 12 16:27:55.047394 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 611/1224] 10.222.0.67 () {60 vars in 1258 bytes} [Tue Apr 12 16:27:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327994734 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:27:58.974796 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:58.975373 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:58.981649 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:58.982130 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:58.982897 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:58.983341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:58.996894 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] HTTP exception thrown: Instance d79e2e80-5679-41bd-aab2-6e740d404eb7 could not be found. Apr 12 16:27:58.997487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Returning 404 to user: Instance d79e2e80-5679-41bd-aab2-6e740d404eb7 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:58.998401 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-eca20c21-4841-427d-80fb-fb4f1c98e2e4 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 404 len: 111 microversion: 2.20 time: 0.028231 Apr 12 16:27:58.998972 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 614/1225] 10.222.0.67 () {60 vars in 1279 bytes} [Tue Apr 12 16:27:58 2022] DELETE /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:27:59.007603 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:59.008320 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: d79e2e80-5679-41bd-aab2-6e740d404eb7] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:27:59.016306 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:59.016873 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:59.017739 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:27:59.018307 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:27:59.032165 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] HTTP exception thrown: Instance d79e2e80-5679-41bd-aab2-6e740d404eb7 could not be found. Apr 12 16:27:59.032791 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Returning 404 to user: Instance d79e2e80-5679-41bd-aab2-6e740d404eb7 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:27:59.033822 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f3383283-3c38-4757-bd2e-8e40a446ea06 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7" status: 404 len: 111 microversion: 2.20 time: 0.030319 Apr 12 16:27:59.034616 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 612/1226] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:27:59 2022] GET /compute/v2.1/servers/d79e2e80-5679-41bd-aab2-6e740d404eb7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:28:00.174599 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:00.175158 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:28:00.181609 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:28:00.182064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:28:00.182838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:28:00.183268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:28:00.197117 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] HTTP exception thrown: Instance 29f48c36-5e37-4640-b589-df261265d809 could not be found. Apr 12 16:28:00.197703 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Returning 404 to user: Instance 29f48c36-5e37-4640-b589-df261265d809 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:28:00.198535 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bd0c0344-28bb-4826-9956-553aadf31309 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "DELETE /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 404 len: 111 microversion: 2.20 time: 0.028404 Apr 12 16:28:00.199283 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 615/1227] 10.222.0.67 () {60 vars in 1279 bytes} [Tue Apr 12 16:28:00 2022] DELETE /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:28:00.207226 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:00.207853 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] [instance: 29f48c36-5e37-4640-b589-df261265d809] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:28:00.214512 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:28:00.214970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:28:00.215749 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:28:00.216185 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:28:00.230205 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] HTTP exception thrown: Instance 29f48c36-5e37-4640-b589-df261265d809 could not be found. Apr 12 16:28:00.230786 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] Returning 404 to user: Instance 29f48c36-5e37-4640-b589-df261265d809 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:28:00.231625 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-fd4c7085-dd37-4372-9611-1ea57c7d2f73 tempest-AttachVolumeShelveTestJSON-274803867 tempest-AttachVolumeShelveTestJSON-274803867-project] 10.222.0.67 "GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809" status: 404 len: 111 microversion: 2.20 time: 0.028427 Apr 12 16:28:00.232107 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 613/1228] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Apr 12 16:28:00 2022] GET /compute/v2.1/servers/29f48c36-5e37-4640-b589-df261265d809 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:28:06.059250 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-e3b4aa54-9c8f-42e9-a486-b6f452b5039e tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Action: 'create', calling method: .version_select at 0x7f246da89700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-66967577"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:28:06.396248 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-e3b4aa54-9c8f-42e9-a486-b6f452b5039e tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.466110 Apr 12 16:28:06.397163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 616/1229] 10.222.0.67 () {60 vars in 1154 bytes} [Tue Apr 12 16:28:05 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 468 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 12 16:28:06.410050 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b23de9f2-13c2-4bef-9063-de47f8899994 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246eeec8b0>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:06.473014 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b23de9f2-13c2-4bef-9063-de47f8899994 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63" status: 200 len: 343 microversion: 2.1 time: 0.068091 Apr 12 16:28:06.473587 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 614/1230] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:28:06 2022] GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63 => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:07.486241 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-61b29d08-4f95-49e5-adb1-59e1109ce1c4 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246da10280>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:07.551084 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-61b29d08-4f95-49e5-adb1-59e1109ce1c4 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63" status: 200 len: 344 microversion: 2.1 time: 0.064939 Apr 12 16:28:07.558601 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 617/1231] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:28:07 2022] GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:07.565429 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0f00f156-b374-4aa4-9fc8-0b55da1f3fd1 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Action: 'create', calling method: .version_select at 0x7f246d951940>, body: {"snapshot": {"volume_id": "ea417007-7ef1-45b4-9b6b-55c486d52d63", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1554688138"}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:28:07.763151 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0f00f156-b374-4aa4-9fc8-0b55da1f3fd1 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.204182 Apr 12 16:28:07.764310 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 615/1232] 10.222.0.67 () {60 vars in 1161 bytes} [Tue Apr 12 16:28:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:07.773882 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-61f51056-fcd9-484d-9807-8a0d0ef5962e tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246e6d4ca0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:07.818554 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-61f51056-fcd9-484d-9807-8a0d0ef5962e tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902" status: 200 len: 287 microversion: 2.1 time: 0.048235 Apr 12 16:28:07.819199 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 618/1233] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Apr 12 16:28:07 2022] GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:07.829966 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-53f7d654-7c38-41b0-948f-a696bc7ee5e4 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246dbe5820>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:07.861783 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-53f7d654-7c38-41b0-948f-a696bc7ee5e4 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036053 Apr 12 16:28:07.862406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 616/1234] 10.222.0.67 () {58 vars in 1139 bytes} [Tue Apr 12 16:28:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:28:07.873089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ceabb0e3-3f7a-4311-bfab-6eed55d863b9 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246e56e0d0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:07.904948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ceabb0e3-3f7a-4311-bfab-6eed55d863b9 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902" status: 200 len: 287 microversion: 2.1 time: 0.036403 Apr 12 16:28:07.905745 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 619/1235] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Apr 12 16:28:07 2022] GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:08.917537 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-04126cd4-8830-4c05-903e-fb946b24942c tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246d951e50>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:08.949547 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-04126cd4-8830-4c05-903e-fb946b24942c tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902" status: 200 len: 287 microversion: 2.1 time: 0.036379 Apr 12 16:28:08.950155 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 617/1236] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Apr 12 16:28:08 2022] GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:09.963043 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-1302950f-d866-430b-86a7-ea257b7d600c tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246da895e0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:09.998553 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-1302950f-d866-430b-86a7-ea257b7d600c tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902" status: 200 len: 287 microversion: 2.1 time: 0.040381 Apr 12 16:28:09.999142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 620/1237] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Apr 12 16:28:09 2022] GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:11.010690 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-844c901e-1057-4689-a134-a5fe682fb6e7 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246d95d9d0>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:11.058083 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-844c901e-1057-4689-a134-a5fe682fb6e7 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902" status: 200 len: 288 microversion: 2.1 time: 0.051393 Apr 12 16:28:11.058280 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 618/1238] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Apr 12 16:28:11 2022] GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902 => generated 288 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:11.069766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-59359d08-fc96-4263-94b1-0f54ab4f35f7 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246da893a0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:11.129509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-59359d08-fc96-4263-94b1-0f54ab4f35f7 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902" status: 202 len: 0 microversion: 2.1 time: 0.063790 Apr 12 16:28:11.133086 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 621/1239] 10.222.0.67 () {58 vars in 1253 bytes} [Tue Apr 12 16:28:11 2022] DELETE /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:28:11.138327 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-20cc9dca-da8f-43a6-98e7-bbc73a0a50ea tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246dea1790>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:11.167994 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-20cc9dca-da8f-43a6-98e7-bbc73a0a50ea tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902" status: 200 len: 287 microversion: 2.1 time: 0.033551 Apr 12 16:28:11.168564 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 619/1240] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Apr 12 16:28:11 2022] GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:12.180444 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-54fa4d35-ae9c-4623-8443-29fbdbe41d50 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246da5bdc0>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:12.206065 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-54fa4d35-ae9c-4623-8443-29fbdbe41d50 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] HTTP exception thrown: Snapshot 66aada85-9d74-475f-b372-856d55de4902 could not be found. Apr 12 16:28:12.206929 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-54fa4d35-ae9c-4623-8443-29fbdbe41d50 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Returning 404 to user: Snapshot 66aada85-9d74-475f-b372-856d55de4902 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:28:12.207831 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-54fa4d35-ae9c-4623-8443-29fbdbe41d50 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902" status: 404 len: 111 microversion: 2.1 time: 0.031849 Apr 12 16:28:12.208457 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 622/1241] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Apr 12 16:28:12 2022] GET /compute/v2.1/os-snapshots/66aada85-9d74-475f-b372-856d55de4902 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:28:12.217154 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4dc2ab1d-b467-4966-b7b3-6b909f204a0c tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246d95da60>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:12.280190 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4dc2ab1d-b467-4966-b7b3-6b909f204a0c tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63" status: 202 len: 0 microversion: 2.1 time: 0.067184 Apr 12 16:28:12.280854 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 620/1242] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:28:12 2022] DELETE /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:28:12.291105 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-37b25d76-2597-455d-a7da-75d2be5a48ad tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246da5b670>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:12.368423 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-37b25d76-2597-455d-a7da-75d2be5a48ad tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63" status: 200 len: 343 microversion: 2.1 time: 0.081537 Apr 12 16:28:12.374644 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 623/1243] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:28:12 2022] GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63 => generated 343 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:13.382990 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-433abb51-afe9-4bb7-a5f9-2554c8773687 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246d9515e0>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:13.410542 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-433abb51-afe9-4bb7-a5f9-2554c8773687 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] HTTP exception thrown: Volume ea417007-7ef1-45b4-9b6b-55c486d52d63 could not be found. Apr 12 16:28:13.411137 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-433abb51-afe9-4bb7-a5f9-2554c8773687 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Returning 404 to user: Volume ea417007-7ef1-45b4-9b6b-55c486d52d63 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:28:13.411979 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-433abb51-afe9-4bb7-a5f9-2554c8773687 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63" status: 404 len: 109 microversion: 2.1 time: 0.033628 Apr 12 16:28:13.412531 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 621/1244] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:28:13 2022] GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:28:13.427022 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a9d2ff83-9693-4704-a949-cebb72b380a0 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246da89040>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:13.454738 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-a9d2ff83-9693-4704-a949-cebb72b380a0 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] HTTP exception thrown: Volume ea417007-7ef1-45b4-9b6b-55c486d52d63 could not be found. Apr 12 16:28:13.456222 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a9d2ff83-9693-4704-a949-cebb72b380a0 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Returning 404 to user: Volume ea417007-7ef1-45b4-9b6b-55c486d52d63 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:28:13.457064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a9d2ff83-9693-4704-a949-cebb72b380a0 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63" status: 404 len: 109 microversion: 2.1 time: 0.034659 Apr 12 16:28:13.457755 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 624/1245] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Apr 12 16:28:13 2022] DELETE /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:28:13.466301 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9049ad01-ebb4-44b2-946f-10b9542a1886 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Calling method '.version_select at 0x7f246dec3280>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:13.493601 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-9049ad01-ebb4-44b2-946f-10b9542a1886 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] HTTP exception thrown: Volume ea417007-7ef1-45b4-9b6b-55c486d52d63 could not be found. Apr 12 16:28:13.494266 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-9049ad01-ebb4-44b2-946f-10b9542a1886 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] Returning 404 to user: Volume ea417007-7ef1-45b4-9b6b-55c486d52d63 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:28:13.495148 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-9049ad01-ebb4-44b2-946f-10b9542a1886 tempest-VolumesSnapshotsTestJSON-835138331 tempest-VolumesSnapshotsTestJSON-835138331-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63" status: 404 len: 109 microversion: 2.1 time: 0.033354 Apr 12 16:28:13.495868 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 622/1246] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Apr 12 16:28:13 2022] GET /compute/v2.1/os-volumes/ea417007-7ef1-45b4-9b6b-55c486d52d63 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:29:29.587576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-76f271cd-110e-43dd-b538-b5f0c5059e6a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Action: 'create', calling method: .version_select at 0x7f246e55f160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1463700145"}} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:29:29.602593 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-76f271cd-110e-43dd-b538-b5f0c5059e6a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Getting quotas for project a7f38a4892a04f7d98a6c1b1c1dfbd89. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:29:29.606960 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-76f271cd-110e-43dd-b538-b5f0c5059e6a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Getting quotas for user c57243ae715c428a91234a8eadfff473 and project a7f38a4892a04f7d98a6c1b1c1dfbd89. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:29:29.793628 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-76f271cd-110e-43dd-b538-b5f0c5059e6a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Getting quotas for project a7f38a4892a04f7d98a6c1b1c1dfbd89. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:29:29.798400 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.quota [None req-76f271cd-110e-43dd-b538-b5f0c5059e6a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Getting quotas for user c57243ae715c428a91234a8eadfff473 and project a7f38a4892a04f7d98a6c1b1c1dfbd89. Resources: {'key_pairs'} {{(pid=117202) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:29:29.813505 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-76f271cd-110e-43dd-b538-b5f0c5059e6a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.418981 Apr 12 16:29:29.814346 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 625/1247] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Apr 12 16:29:29 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:40.227865 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-cd5f7695-e60c-43cf-a22d-ab5b3f5324ff tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:40.228490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-cd5f7695-e60c-43cf-a22d-ab5b3f5324ff tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:40.237363 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd5f7695-e60c-43cf-a22d-ab5b3f5324ff tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:40.237846 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd5f7695-e60c-43cf-a22d-ab5b3f5324ff tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:40.238775 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd5f7695-e60c-43cf-a22d-ab5b3f5324ff tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:40.239207 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-cd5f7695-e60c-43cf-a22d-ab5b3f5324ff tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:40.265570 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-cd5f7695-e60c-43cf-a22d-ab5b3f5324ff tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Going to try to terminate instance {{(pid=117201) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:29:40.294695 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-1db855e5-3de8-4af8-97b8-491e4c5e0ed0 req-32ef3a4b-5f5e-4349-ba74-67a514293015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b", "tag": "d861fdfc-9161-44f1-a933-dd10d7398a1e"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:29:40.303948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-1db855e5-3de8-4af8-97b8-491e4c5e0ed0 req-32ef3a4b-5f5e-4349-ba74-67a514293015 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:40.304409 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-1db855e5-3de8-4af8-97b8-491e4c5e0ed0 req-32ef3a4b-5f5e-4349-ba74-67a514293015 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:40.317268 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-1db855e5-3de8-4af8-97b8-491e4c5e0ed0 req-32ef3a4b-5f5e-4349-ba74-67a514293015 service nova] Creating event network-changed:d861fdfc-9161-44f1-a933-dd10d7398a1e for instance 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b on hv-cinder-83752 Apr 12 16:29:40.324054 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-1db855e5-3de8-4af8-97b8-491e4c5e0ed0 req-32ef3a4b-5f5e-4349-ba74-67a514293015 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098988 Apr 12 16:29:40.324708 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 626/1248] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:29:40.356308 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-cd5f7695-e60c-43cf-a22d-ab5b3f5324ff tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 204 len: 0 microversion: 2.1 time: 0.134275 Apr 12 16:29:40.357368 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 623/1249] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:29:40 2022] DELETE /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:29:40.368727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a8d181a4-c5c5-4b49-bf71-a21d217a5b0a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:40.369671 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a8d181a4-c5c5-4b49-bf71-a21d217a5b0a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:40.377091 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a8d181a4-c5c5-4b49-bf71-a21d217a5b0a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:40.380777 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a8d181a4-c5c5-4b49-bf71-a21d217a5b0a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:40.381682 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a8d181a4-c5c5-4b49-bf71-a21d217a5b0a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:40.382225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a8d181a4-c5c5-4b49-bf71-a21d217a5b0a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:40.584681 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a8d181a4-c5c5-4b49-bf71-a21d217a5b0a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:40.594472 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a8d181a4-c5c5-4b49-bf71-a21d217a5b0a tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1576 microversion: 2.1 time: 0.230666 Apr 12 16:29:40.595162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 627/1250] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:40 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:41.613528 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c900d088-1c69-44b2-9bc3-798b11b63e6c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:41.614623 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c900d088-1c69-44b2-9bc3-798b11b63e6c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:41.621963 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c900d088-1c69-44b2-9bc3-798b11b63e6c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:41.622464 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c900d088-1c69-44b2-9bc3-798b11b63e6c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:41.623238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c900d088-1c69-44b2-9bc3-798b11b63e6c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:41.623672 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c900d088-1c69-44b2-9bc3-798b11b63e6c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:41.819651 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-c900d088-1c69-44b2-9bc3-798b11b63e6c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:41.829069 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c900d088-1c69-44b2-9bc3-798b11b63e6c tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1576 microversion: 2.1 time: 0.220154 Apr 12 16:29:41.829628 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 624/1251] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:41 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:42.849228 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-78d2b571-8927-4596-ad17-ff956ba7464d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:42.850079 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-78d2b571-8927-4596-ad17-ff956ba7464d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:42.857120 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-78d2b571-8927-4596-ad17-ff956ba7464d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:42.857576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-78d2b571-8927-4596-ad17-ff956ba7464d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:42.858443 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-78d2b571-8927-4596-ad17-ff956ba7464d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:42.858878 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-78d2b571-8927-4596-ad17-ff956ba7464d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:43.006888 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-78d2b571-8927-4596-ad17-ff956ba7464d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:43.019375 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-78d2b571-8927-4596-ad17-ff956ba7464d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1576 microversion: 2.1 time: 0.175508 Apr 12 16:29:43.019954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 628/1252] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:42 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:44.037735 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3776e2b4-a727-4345-9faa-c2b0ba8564e2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:44.038549 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3776e2b4-a727-4345-9faa-c2b0ba8564e2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:44.046769 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3776e2b4-a727-4345-9faa-c2b0ba8564e2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:44.047215 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3776e2b4-a727-4345-9faa-c2b0ba8564e2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:44.048017 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3776e2b4-a727-4345-9faa-c2b0ba8564e2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:44.048406 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3776e2b4-a727-4345-9faa-c2b0ba8564e2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:44.198518 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3776e2b4-a727-4345-9faa-c2b0ba8564e2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:44.207058 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3776e2b4-a727-4345-9faa-c2b0ba8564e2 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1576 microversion: 2.1 time: 0.173988 Apr 12 16:29:44.207596 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 625/1253] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:44 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:45.231773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2b87c901-0ee1-4236-8954-d5f0f8acb56f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:45.232524 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2b87c901-0ee1-4236-8954-d5f0f8acb56f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:45.239559 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2b87c901-0ee1-4236-8954-d5f0f8acb56f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:45.240032 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2b87c901-0ee1-4236-8954-d5f0f8acb56f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:45.240967 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2b87c901-0ee1-4236-8954-d5f0f8acb56f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:45.241349 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2b87c901-0ee1-4236-8954-d5f0f8acb56f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:45.380229 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-e448de01-4ed0-494a-81c3-a63f0e53c1a0 req-d88ff86d-0336-4059-9dd4-913741c69330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b", "name": "network-vif-unplugged", "status": "completed", "tag": "d861fdfc-9161-44f1-a933-dd10d7398a1e"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:29:45.388986 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-e448de01-4ed0-494a-81c3-a63f0e53c1a0 req-d88ff86d-0336-4059-9dd4-913741c69330 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:45.389423 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-e448de01-4ed0-494a-81c3-a63f0e53c1a0 req-d88ff86d-0336-4059-9dd4-913741c69330 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:45.398985 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2b87c901-0ee1-4236-8954-d5f0f8acb56f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:45.400970 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-e448de01-4ed0-494a-81c3-a63f0e53c1a0 req-d88ff86d-0336-4059-9dd4-913741c69330 service nova] Creating event network-vif-unplugged:d861fdfc-9161-44f1-a933-dd10d7398a1e for instance 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b on hv-cinder-83752 Apr 12 16:29:45.406405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-e448de01-4ed0-494a-81c3-a63f0e53c1a0 req-d88ff86d-0336-4059-9dd4-913741c69330 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106317 Apr 12 16:29:45.407026 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2b87c901-0ee1-4236-8954-d5f0f8acb56f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1576 microversion: 2.1 time: 0.179594 Apr 12 16:29:45.407732 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 629/1255] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:45 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:45.408685 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 626/1255] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:29:46.428151 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-53f90309-2b76-412a-80a9-97308c746873 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:46.428997 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-53f90309-2b76-412a-80a9-97308c746873 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:46.437245 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-53f90309-2b76-412a-80a9-97308c746873 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:46.437699 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-53f90309-2b76-412a-80a9-97308c746873 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:46.438510 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-53f90309-2b76-412a-80a9-97308c746873 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:46.438948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-53f90309-2b76-412a-80a9-97308c746873 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:46.578580 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-53f90309-2b76-412a-80a9-97308c746873 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:46.590507 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-53f90309-2b76-412a-80a9-97308c746873 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1576 microversion: 2.1 time: 0.168729 Apr 12 16:29:46.591167 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 630/1256] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:46 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:47.609247 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-473bd06c-f4d4-454f-b79c-6a04533ce870 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:47.609947 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-473bd06c-f4d4-454f-b79c-6a04533ce870 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:47.616395 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-473bd06c-f4d4-454f-b79c-6a04533ce870 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:47.616853 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-473bd06c-f4d4-454f-b79c-6a04533ce870 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:47.617639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-473bd06c-f4d4-454f-b79c-6a04533ce870 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:47.618095 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-473bd06c-f4d4-454f-b79c-6a04533ce870 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:48.234739 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-473bd06c-f4d4-454f-b79c-6a04533ce870 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:48.242442 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-473bd06c-f4d4-454f-b79c-6a04533ce870 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1576 microversion: 2.1 time: 0.638017 Apr 12 16:29:48.243032 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 627/1257] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:47 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1576 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:48.574341 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-05324fbe-56f5-48d5-94f9-355c8e902d51 req-e8d7b939-c4ec-4cfe-a79a-ab9576171339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b", "name": "network-vif-deleted", "tag": "d861fdfc-9161-44f1-a933-dd10d7398a1e"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:29:48.583122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-05324fbe-56f5-48d5-94f9-355c8e902d51 req-e8d7b939-c4ec-4cfe-a79a-ab9576171339 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:48.583562 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-05324fbe-56f5-48d5-94f9-355c8e902d51 req-e8d7b939-c4ec-4cfe-a79a-ab9576171339 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:48.597509 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-05324fbe-56f5-48d5-94f9-355c8e902d51 req-e8d7b939-c4ec-4cfe-a79a-ab9576171339 service nova] Creating event network-vif-deleted:d861fdfc-9161-44f1-a933-dd10d7398a1e for instance 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b on hv-cinder-83752 Apr 12 16:29:48.602836 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-05324fbe-56f5-48d5-94f9-355c8e902d51 req-e8d7b939-c4ec-4cfe-a79a-ab9576171339 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Apr 12 16:29:48.603442 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 631/1258] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:29:49.262232 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:49.262880 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:49.270068 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:49.270548 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:49.271344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:49.271804 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:49.306430 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:49.306902 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:49.307852 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lazy-loading 'fault' on Instance uuid 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:29:49.351706 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:49.361101 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f485c35c-cfb6-4c26-9258-b452f613cf98 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 200 len: 1229 microversion: 2.1 time: 0.104448 Apr 12 16:29:49.362086 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 628/1259] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:49 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:29:50.380282 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:50.380905 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:50.387513 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:50.387954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:50.388713 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:50.389143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:50.402844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] HTTP exception thrown: Instance 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b could not be found. Apr 12 16:29:50.403438 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Returning 404 to user: Instance 0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:29:50.404270 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0cb9d3fe-ac85-4397-a5d5-400b395e02bf tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b" status: 404 len: 111 microversion: 2.1 time: 0.029423 Apr 12 16:29:50.404827 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 632/1260] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:50 2022] GET /compute/v2.1/servers/0c85e1e5-b6a3-4e04-b19e-f5afd3e5fa1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:29:52.514242 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-959288593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1463700145", "security_groups": [{"name": "tempest-secgroup-smoke-213485769"}], "networks": [{"uuid": "3e91be54-ab95-4f86-bb8d-bf46786b514f"}], "block_device_mapping_v2": [{"uuid": "6c9a0a40-2349-465f-90b4-788de0512529", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:29:52.640419 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.network.neutron [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] validate_networks() for [('3e91be54-ab95-4f86-bb8d-bf46786b514f', None, None, None, None, None)] {{(pid=117201) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 16:29:53.083357 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Flavor limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:29:53.083883 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Image limits 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:29:53.084576 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Flavor pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:29:53.085159 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Image pref 0:0:0 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:29:53.085746 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.virt.hardware [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:29:53.095062 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:53.095504 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:53.096300 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:53.096729 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:53.113857 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Getting quotas for project a7f38a4892a04f7d98a6c1b1c1dfbd89. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:29:53.117936 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.quota [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Getting quotas for user c57243ae715c428a91234a8eadfff473 and project a7f38a4892a04f7d98a6c1b1c1dfbd89. Resources: {'cores', 'ram', 'instances'} {{(pid=117201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:29:53.190639 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Going to run 1 instances... {{(pid=117201) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 16:29:53.193491 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c9a0a40-2349-465f-90b4-788de0512529',volume_size=None,volume_type=None)] {{(pid=117201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 16:29:53.332051 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6db9181d-cffd-4e48-a4de-e5474bf6e94b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.821716 Apr 12 16:29:53.332881 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 629/1261] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Apr 12 16:29:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:29:53.344487 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c689a159-544d-4bf0-9873-182a18a4f987 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:53.345111 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c689a159-544d-4bf0-9873-182a18a4f987 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:53.407288 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c689a159-544d-4bf0-9873-182a18a4f987 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:53.414362 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c689a159-544d-4bf0-9873-182a18a4f987 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1088 microversion: 2.1 time: 0.074715 Apr 12 16:29:53.415261 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 633/1262] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:53 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:53.871716 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-c7834fc0-fad0-4567-8fdd-a0bd59d61175 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:53.872565 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c7834fc0-fad0-4567-8fdd-a0bd59d61175 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:53.882587 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7834fc0-fad0-4567-8fdd-a0bd59d61175 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:53.883141 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7834fc0-fad0-4567-8fdd-a0bd59d61175 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:53.884833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7834fc0-fad0-4567-8fdd-a0bd59d61175 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:53.885396 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-c7834fc0-fad0-4567-8fdd-a0bd59d61175 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:53.922463 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-c7834fc0-fad0-4567-8fdd-a0bd59d61175 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Going to try to terminate instance {{(pid=117201) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:29:53.951612 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-b03ca2e9-fd09-4e44-a50d-98e72371e66a req-1fc98406-b10f-461f-a60a-fdc5556127ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842d987b-d6f3-432b-b6e5-311a36e9ba0a", "tag": "60428b9a-7b1b-43fb-8999-73bc88945670"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:29:53.964659 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b03ca2e9-fd09-4e44-a50d-98e72371e66a req-1fc98406-b10f-461f-a60a-fdc5556127ee service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:53.965230 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-b03ca2e9-fd09-4e44-a50d-98e72371e66a req-1fc98406-b10f-461f-a60a-fdc5556127ee service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:53.980351 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-b03ca2e9-fd09-4e44-a50d-98e72371e66a req-1fc98406-b10f-461f-a60a-fdc5556127ee service nova] Creating event network-changed:60428b9a-7b1b-43fb-8999-73bc88945670 for instance 842d987b-d6f3-432b-b6e5-311a36e9ba0a on hv-cinder-83752 Apr 12 16:29:53.986448 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-b03ca2e9-fd09-4e44-a50d-98e72371e66a req-1fc98406-b10f-461f-a60a-fdc5556127ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106265 Apr 12 16:29:53.988491 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 634/1263] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:29:54.025438 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-c7834fc0-fad0-4567-8fdd-a0bd59d61175 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "DELETE /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 204 len: 0 microversion: 2.1 time: 0.158220 Apr 12 16:29:54.027111 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 630/1264] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:29:53 2022] DELETE /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:29:54.036118 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-b504b74c-ea70-4b2c-9f46-d1e955f533d1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:54.037209 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-b504b74c-ea70-4b2c-9f46-d1e955f533d1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:54.044561 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b504b74c-ea70-4b2c-9f46-d1e955f533d1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:54.045355 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b504b74c-ea70-4b2c-9f46-d1e955f533d1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:54.046326 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b504b74c-ea70-4b2c-9f46-d1e955f533d1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:54.046948 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-b504b74c-ea70-4b2c-9f46-d1e955f533d1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:54.184315 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-b504b74c-ea70-4b2c-9f46-d1e955f533d1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:54.192606 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-b504b74c-ea70-4b2c-9f46-d1e955f533d1 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1577 microversion: 2.1 time: 0.160914 Apr 12 16:29:54.193280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 635/1265] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:54 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:54.438100 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-8670b095-9bc1-43ba-ad9c-2302aac2c8ab tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:54.438710 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-8670b095-9bc1-43ba-ad9c-2302aac2c8ab tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:54.445783 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8670b095-9bc1-43ba-ad9c-2302aac2c8ab tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:54.446262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8670b095-9bc1-43ba-ad9c-2302aac2c8ab tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:54.447079 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8670b095-9bc1-43ba-ad9c-2302aac2c8ab tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:54.447510 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-8670b095-9bc1-43ba-ad9c-2302aac2c8ab tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:54.512031 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-8670b095-9bc1-43ba-ad9c-2302aac2c8ab tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:54.521569 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-8670b095-9bc1-43ba-ad9c-2302aac2c8ab tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1186 microversion: 2.1 time: 0.087879 Apr 12 16:29:54.524840 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 631/1266] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:54 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:55.210523 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-2db987c3-f63e-41d1-8ff4-1097c9cccc91 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:55.211276 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-2db987c3-f63e-41d1-8ff4-1097c9cccc91 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:55.217912 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2db987c3-f63e-41d1-8ff4-1097c9cccc91 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:55.218403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2db987c3-f63e-41d1-8ff4-1097c9cccc91 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:55.219179 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2db987c3-f63e-41d1-8ff4-1097c9cccc91 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:55.219619 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-2db987c3-f63e-41d1-8ff4-1097c9cccc91 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:55.397234 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-2db987c3-f63e-41d1-8ff4-1097c9cccc91 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:55.407406 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-2db987c3-f63e-41d1-8ff4-1097c9cccc91 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1577 microversion: 2.1 time: 0.200552 Apr 12 16:29:55.408099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 636/1267] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:55 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:55.543795 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d75a1034-00f5-421a-9f48-0896c960cc80 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:55.544499 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d75a1034-00f5-421a-9f48-0896c960cc80 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:55.556220 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d75a1034-00f5-421a-9f48-0896c960cc80 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:55.556802 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d75a1034-00f5-421a-9f48-0896c960cc80 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:55.557851 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d75a1034-00f5-421a-9f48-0896c960cc80 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:55.558334 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d75a1034-00f5-421a-9f48-0896c960cc80 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:55.625277 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d75a1034-00f5-421a-9f48-0896c960cc80 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:55.632968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d75a1034-00f5-421a-9f48-0896c960cc80 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1186 microversion: 2.1 time: 0.096542 Apr 12 16:29:55.633522 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 632/1268] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:55 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:56.428999 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ab47e61d-7631-41c5-a75f-96bacee3347b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:56.429914 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ab47e61d-7631-41c5-a75f-96bacee3347b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:56.437634 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab47e61d-7631-41c5-a75f-96bacee3347b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:56.438254 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab47e61d-7631-41c5-a75f-96bacee3347b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:56.439157 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab47e61d-7631-41c5-a75f-96bacee3347b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:56.439700 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ab47e61d-7631-41c5-a75f-96bacee3347b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:56.652723 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1d4caed2-2867-41c7-a50b-36cf79e39664 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:56.653505 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1d4caed2-2867-41c7-a50b-36cf79e39664 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:56.665377 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d4caed2-2867-41c7-a50b-36cf79e39664 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:56.665867 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d4caed2-2867-41c7-a50b-36cf79e39664 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:56.666731 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d4caed2-2867-41c7-a50b-36cf79e39664 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:56.670205 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1d4caed2-2867-41c7-a50b-36cf79e39664 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:56.786988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ab47e61d-7631-41c5-a75f-96bacee3347b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:56.796750 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ab47e61d-7631-41c5-a75f-96bacee3347b tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1577 microversion: 2.1 time: 0.372091 Apr 12 16:29:56.797739 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 637/1269] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:56 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1577 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:56.952968 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-1d4caed2-2867-41c7-a50b-36cf79e39664 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:56.962763 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1d4caed2-2867-41c7-a50b-36cf79e39664 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1271 microversion: 2.1 time: 0.316387 Apr 12 16:29:56.963650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 633/1270] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:56 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1271 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:29:56.992193 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-13e45c6d-09b8-42b3-ac43-ed3b2d3e1137 req-122cf171-c918-40d8-a172-8f6398801aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842d987b-d6f3-432b-b6e5-311a36e9ba0a", "name": "network-vif-deleted", "tag": "60428b9a-7b1b-43fb-8999-73bc88945670"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:29:57.002660 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-13e45c6d-09b8-42b3-ac43-ed3b2d3e1137 req-122cf171-c918-40d8-a172-8f6398801aa3 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:57.003416 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-13e45c6d-09b8-42b3-ac43-ed3b2d3e1137 req-122cf171-c918-40d8-a172-8f6398801aa3 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:57.016930 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-13e45c6d-09b8-42b3-ac43-ed3b2d3e1137 req-122cf171-c918-40d8-a172-8f6398801aa3 service nova] Creating event network-vif-deleted:60428b9a-7b1b-43fb-8999-73bc88945670 for instance 842d987b-d6f3-432b-b6e5-311a36e9ba0a on hv-cinder-83752 Apr 12 16:29:57.022257 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-13e45c6d-09b8-42b3-ac43-ed3b2d3e1137 req-122cf171-c918-40d8-a172-8f6398801aa3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033785 Apr 12 16:29:57.023478 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 638/1271] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:29:57.606338 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-632cd6a2-2ed5-4f6e-8f08-9fba5f2ed6bb req-d10be61f-1790-477d-a830-c207e4b9c9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c7c4d6-0505-46bf-8130-cce01c53b0a1", "tag": "eaa5fff0-49ae-403f-aee0-ecb06b0f8df9"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:29:57.615481 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-632cd6a2-2ed5-4f6e-8f08-9fba5f2ed6bb req-d10be61f-1790-477d-a830-c207e4b9c9c6 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:57.616021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-632cd6a2-2ed5-4f6e-8f08-9fba5f2ed6bb req-d10be61f-1790-477d-a830-c207e4b9c9c6 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:57.648316 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-632cd6a2-2ed5-4f6e-8f08-9fba5f2ed6bb req-d10be61f-1790-477d-a830-c207e4b9c9c6 service nova] Creating event network-changed:eaa5fff0-49ae-403f-aee0-ecb06b0f8df9 for instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1 on hv-cinder-83752 Apr 12 16:29:57.654833 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-632cd6a2-2ed5-4f6e-8f08-9fba5f2ed6bb req-d10be61f-1790-477d-a830-c207e4b9c9c6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053685 Apr 12 16:29:57.655577 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 634/1272] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:29:57.819462 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:57.820342 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:57.828339 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:57.829596 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:57.830885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:57.831505 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:57.865803 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:57.866205 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:57.866733 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.objects.instance [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lazy-loading 'fault' on Instance uuid 842d987b-d6f3-432b-b6e5-311a36e9ba0a {{(pid=117202) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:29:57.909534 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72b05bd57f241128f065c0b94663f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdb664508148aab946b17b16013559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:57.916355 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-803525a4-2089-4910-a139-72c3dfa850aa tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 200 len: 1184 microversion: 2.1 time: 0.102884 Apr 12 16:29:57.916924 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 639/1273] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:57 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 1184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:29:57.981610 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-29c8ce29-5cc3-4e74-a782-4fbae386cd2d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:57.982340 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-29c8ce29-5cc3-4e74-a782-4fbae386cd2d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:57.989428 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-29c8ce29-5cc3-4e74-a782-4fbae386cd2d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:57.989893 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-29c8ce29-5cc3-4e74-a782-4fbae386cd2d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:57.990726 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-29c8ce29-5cc3-4e74-a782-4fbae386cd2d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:57.991165 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-29c8ce29-5cc3-4e74-a782-4fbae386cd2d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:58.125647 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-29c8ce29-5cc3-4e74-a782-4fbae386cd2d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:58.133687 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-29c8ce29-5cc3-4e74-a782-4fbae386cd2d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.156620 Apr 12 16:29:58.134324 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 635/1274] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:57 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:58.933172 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:58.933832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: 842d987b-d6f3-432b-b6e5-311a36e9ba0a] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:58.942351 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:58.942920 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:58.943959 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:58.944628 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:58.962538 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] HTTP exception thrown: Instance 842d987b-d6f3-432b-b6e5-311a36e9ba0a could not be found. Apr 12 16:29:58.963399 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Returning 404 to user: Instance 842d987b-d6f3-432b-b6e5-311a36e9ba0a could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:29:58.964476 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-fbede990-f96e-437f-b35d-8cb3daa1466d tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a" status: 404 len: 111 microversion: 2.1 time: 0.035469 Apr 12 16:29:58.965031 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 640/1275] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:58 2022] GET /compute/v2.1/servers/842d987b-d6f3-432b-b6e5-311a36e9ba0a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:29:59.151993 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d67b0dfe-0172-4ed1-adb9-8a00e69483c9 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:59.153999 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d67b0dfe-0172-4ed1-adb9-8a00e69483c9 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:59.160923 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d67b0dfe-0172-4ed1-adb9-8a00e69483c9 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:59.161722 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d67b0dfe-0172-4ed1-adb9-8a00e69483c9 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:59.163418 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d67b0dfe-0172-4ed1-adb9-8a00e69483c9 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:59.164069 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d67b0dfe-0172-4ed1-adb9-8a00e69483c9 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:59.367590 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d67b0dfe-0172-4ed1-adb9-8a00e69483c9 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:29:59.375776 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d67b0dfe-0172-4ed1-adb9-8a00e69483c9 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.229017 Apr 12 16:29:59.378104 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 636/1276] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:59 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:29:59.534936 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:59.535444 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:59.543123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:59.543571 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:59.544336 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:59.544813 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:59.560774 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.wsgi [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] HTTP exception thrown: Instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 could not be found. Apr 12 16:29:59.561360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Returning 404 to user: Instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 could not be found. {{(pid=117202) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:29:59.562191 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-81e9174c-0a74-404f-ab0e-88e6eb49d73f tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 404 len: 111 microversion: 2.1 time: 0.032214 Apr 12 16:29:59.562758 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 641/1277] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:29:59 2022] DELETE /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:29:59.571483 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:59.572253 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] [instance: a439a34a-3d5a-48a4-8f9c-adbf98011c79] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:29:59.578754 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:59.579212 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:59.580002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:29:59.580443 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:29:59.595050 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] HTTP exception thrown: Instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 could not be found. Apr 12 16:29:59.596082 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Returning 404 to user: Instance a439a34a-3d5a-48a4-8f9c-adbf98011c79 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:29:59.597446 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f5276c0a-8e6f-4e1b-9b95-c661af23e892 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79" status: 404 len: 111 microversion: 2.1 time: 0.029925 Apr 12 16:29:59.597997 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 637/1278] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:29:59 2022] GET /compute/v2.1/servers/a439a34a-3d5a-48a4-8f9c-adbf98011c79 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:30:00.393362 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-bcee6b86-6335-42d8-aeea-db80698e834b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:00.394663 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-bcee6b86-6335-42d8-aeea-db80698e834b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:00.401431 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bcee6b86-6335-42d8-aeea-db80698e834b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:00.401881 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bcee6b86-6335-42d8-aeea-db80698e834b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:00.402704 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bcee6b86-6335-42d8-aeea-db80698e834b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:00.403114 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-bcee6b86-6335-42d8-aeea-db80698e834b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:00.548392 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-bcee6b86-6335-42d8-aeea-db80698e834b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:00.556212 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-bcee6b86-6335-42d8-aeea-db80698e834b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.166472 Apr 12 16:30:00.556974 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 642/1279] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:00 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:00.913744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-f1bc79e3-0e6a-4db5-a993-7b09e9de4fb9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] Calling method '.version_select at 0x7f246db4b940>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:00.935273 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-f1bc79e3-0e6a-4db5-a993-7b09e9de4fb9 tempest-TestVolumeBootPattern-2004413330 tempest-TestVolumeBootPattern-2004413330-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-944614855" status: 202 len: 0 microversion: 2.1 time: 0.025318 Apr 12 16:30:00.935869 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 638/1280] 10.222.0.67 () {58 vars in 1259 bytes} [Tue Apr 12 16:30:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-944614855 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:30:01.573058 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a552d374-521c-4f48-bd1e-f17a79322882 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:01.573674 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a552d374-521c-4f48-bd1e-f17a79322882 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:01.586296 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a552d374-521c-4f48-bd1e-f17a79322882 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:01.586754 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a552d374-521c-4f48-bd1e-f17a79322882 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:01.587537 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a552d374-521c-4f48-bd1e-f17a79322882 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:01.588075 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a552d374-521c-4f48-bd1e-f17a79322882 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:01.741981 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a552d374-521c-4f48-bd1e-f17a79322882 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:01.750072 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a552d374-521c-4f48-bd1e-f17a79322882 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.180882 Apr 12 16:30:01.750623 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 643/1281] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:01 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:02.767740 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a7518e0f-4a81-4db7-a793-b2e5c0aa3eec tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:02.768343 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a7518e0f-4a81-4db7-a793-b2e5c0aa3eec tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:02.778352 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a7518e0f-4a81-4db7-a793-b2e5c0aa3eec tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:02.779152 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a7518e0f-4a81-4db7-a793-b2e5c0aa3eec tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:02.780530 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a7518e0f-4a81-4db7-a793-b2e5c0aa3eec tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:02.781127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a7518e0f-4a81-4db7-a793-b2e5c0aa3eec tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:02.944066 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a7518e0f-4a81-4db7-a793-b2e5c0aa3eec tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:02.952221 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a7518e0f-4a81-4db7-a793-b2e5c0aa3eec tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.188640 Apr 12 16:30:02.962179 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 639/1282] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:02 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:03.970257 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-99cffda5-fe5a-49c2-b1df-c418045a0445 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:03.971517 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-99cffda5-fe5a-49c2-b1df-c418045a0445 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:03.979880 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-99cffda5-fe5a-49c2-b1df-c418045a0445 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:03.980581 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-99cffda5-fe5a-49c2-b1df-c418045a0445 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:03.981368 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-99cffda5-fe5a-49c2-b1df-c418045a0445 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:03.981969 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-99cffda5-fe5a-49c2-b1df-c418045a0445 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:04.225758 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-99cffda5-fe5a-49c2-b1df-c418045a0445 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:04.237165 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-99cffda5-fe5a-49c2-b1df-c418045a0445 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.271605 Apr 12 16:30:04.238436 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 644/1283] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:03 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:05.256243 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b738d42a-b797-46ae-8a35-d79504a892af tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:05.256852 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b738d42a-b797-46ae-8a35-d79504a892af tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:05.265510 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b738d42a-b797-46ae-8a35-d79504a892af tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:05.265951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b738d42a-b797-46ae-8a35-d79504a892af tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:05.266769 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b738d42a-b797-46ae-8a35-d79504a892af tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:05.267484 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b738d42a-b797-46ae-8a35-d79504a892af tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:05.493338 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b738d42a-b797-46ae-8a35-d79504a892af tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:05.501756 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b738d42a-b797-46ae-8a35-d79504a892af tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.249621 Apr 12 16:30:05.511365 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 640/1284] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:05 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:06.519145 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-dfc492a4-33de-49fa-a1d6-2b74eec6f84d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:06.519779 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-dfc492a4-33de-49fa-a1d6-2b74eec6f84d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:06.526952 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dfc492a4-33de-49fa-a1d6-2b74eec6f84d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:06.527401 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dfc492a4-33de-49fa-a1d6-2b74eec6f84d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:06.528184 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dfc492a4-33de-49fa-a1d6-2b74eec6f84d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:06.528616 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-dfc492a4-33de-49fa-a1d6-2b74eec6f84d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:06.674789 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-dfc492a4-33de-49fa-a1d6-2b74eec6f84d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:06.683255 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-dfc492a4-33de-49fa-a1d6-2b74eec6f84d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.168017 Apr 12 16:30:06.683838 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 645/1285] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:06 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:07.460780 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-dd59038f-0861-49bb-8b75-9e8fee0893ff req-9205b90a-fe83-46c0-becd-976249f4e38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c7c4d6-0505-46bf-8130-cce01c53b0a1", "name": "network-vif-plugged", "status": "completed", "tag": "eaa5fff0-49ae-403f-aee0-ecb06b0f8df9"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:30:07.480579 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-dd59038f-0861-49bb-8b75-9e8fee0893ff req-9205b90a-fe83-46c0-becd-976249f4e38f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:07.481312 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-dd59038f-0861-49bb-8b75-9e8fee0893ff req-9205b90a-fe83-46c0-becd-976249f4e38f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:07.496221 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-dd59038f-0861-49bb-8b75-9e8fee0893ff req-9205b90a-fe83-46c0-becd-976249f4e38f service nova] Creating event network-vif-plugged:eaa5fff0-49ae-403f-aee0-ecb06b0f8df9 for instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1 on hv-cinder-83752 Apr 12 16:30:07.504702 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-dd59038f-0861-49bb-8b75-9e8fee0893ff req-9205b90a-fe83-46c0-becd-976249f4e38f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048606 Apr 12 16:30:07.506950 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 641/1286] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:30:07.705094 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0e90c04a-b896-493d-95af-c87da5d136fe tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:07.705723 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0e90c04a-b896-493d-95af-c87da5d136fe tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:07.717593 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0e90c04a-b896-493d-95af-c87da5d136fe tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:07.717970 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0e90c04a-b896-493d-95af-c87da5d136fe tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:07.719253 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0e90c04a-b896-493d-95af-c87da5d136fe tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:07.720018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0e90c04a-b896-493d-95af-c87da5d136fe tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:07.873314 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0e90c04a-b896-493d-95af-c87da5d136fe tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:07.883539 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0e90c04a-b896-493d-95af-c87da5d136fe tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.183695 Apr 12 16:30:07.885055 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 646/1287] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:07 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:08.902839 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-15624513-7c45-4402-b9b2-554793f634a1 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:08.903683 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-15624513-7c45-4402-b9b2-554793f634a1 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:08.910385 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-15624513-7c45-4402-b9b2-554793f634a1 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:08.910940 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-15624513-7c45-4402-b9b2-554793f634a1 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:08.911820 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-15624513-7c45-4402-b9b2-554793f634a1 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:08.912336 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-15624513-7c45-4402-b9b2-554793f634a1 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:09.057157 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-15624513-7c45-4402-b9b2-554793f634a1 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:09.066255 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-15624513-7c45-4402-b9b2-554793f634a1 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1259 microversion: 2.1 time: 0.168380 Apr 12 16:30:09.066942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 642/1288] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:08 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:10.083844 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a0d2a28a-2f22-4d78-abd6-1e431cbad5dd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:10.084612 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a0d2a28a-2f22-4d78-abd6-1e431cbad5dd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:10.091863 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0d2a28a-2f22-4d78-abd6-1e431cbad5dd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:10.092322 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0d2a28a-2f22-4d78-abd6-1e431cbad5dd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:10.093096 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0d2a28a-2f22-4d78-abd6-1e431cbad5dd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:10.093617 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a0d2a28a-2f22-4d78-abd6-1e431cbad5dd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:10.249111 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a0d2a28a-2f22-4d78-abd6-1e431cbad5dd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:10.258204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a0d2a28a-2f22-4d78-abd6-1e431cbad5dd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1443 microversion: 2.1 time: 0.178540 Apr 12 16:30:10.258714 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 647/1289] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:10 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:10.274133 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-25a9a0ad-c983-4ba4-831a-750ba5447792 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:10.274837 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-25a9a0ad-c983-4ba4-831a-750ba5447792 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:30:10.281671 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-25a9a0ad-c983-4ba4-831a-750ba5447792 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:10.282238 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-25a9a0ad-c983-4ba4-831a-750ba5447792 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:10.283015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-25a9a0ad-c983-4ba4-831a-750ba5447792 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:10.283449 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-25a9a0ad-c983-4ba4-831a-750ba5447792 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:10.429535 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-25a9a0ad-c983-4ba4-831a-750ba5447792 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:30:10.438842 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-25a9a0ad-c983-4ba4-831a-750ba5447792 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1443 microversion: 2.1 time: 0.168436 Apr 12 16:30:10.439433 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 643/1290] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:30:10 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:30:12.677765 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-bb304978-58ad-42f2-aa62-25dd97108a2d req-885faf03-34f5-4097-91ba-f7d90015a68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c7c4d6-0505-46bf-8130-cce01c53b0a1", "tag": "eaa5fff0-49ae-403f-aee0-ecb06b0f8df9"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:30:12.688543 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-bb304978-58ad-42f2-aa62-25dd97108a2d req-885faf03-34f5-4097-91ba-f7d90015a68e service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:30:12.689309 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-bb304978-58ad-42f2-aa62-25dd97108a2d req-885faf03-34f5-4097-91ba-f7d90015a68e service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:30:12.705589 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-bb304978-58ad-42f2-aa62-25dd97108a2d req-885faf03-34f5-4097-91ba-f7d90015a68e service nova] Creating event network-changed:eaa5fff0-49ae-403f-aee0-ecb06b0f8df9 for instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1 on hv-cinder-83752 Apr 12 16:30:12.712810 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-bb304978-58ad-42f2-aa62-25dd97108a2d req-885faf03-34f5-4097-91ba-f7d90015a68e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038606 Apr 12 16:30:12.713466 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 648/1291] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:30:14.941972 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:30:14.942694 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: Tue Apr 12 16:30:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:32:07.976410 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:32:07.977256 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: Tue Apr 12 16:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:32:11.372239 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-1c609abf-e815-4c80-82c6-22ca98714e3e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:32:11.372874 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-1c609abf-e815-4c80-82c6-22ca98714e3e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:11.383814 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1c609abf-e815-4c80-82c6-22ca98714e3e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:11.384184 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1c609abf-e815-4c80-82c6-22ca98714e3e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:11.385009 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1c609abf-e815-4c80-82c6-22ca98714e3e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:11.385453 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-1c609abf-e815-4c80-82c6-22ca98714e3e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:11.409901 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.objects.instance [None req-1c609abf-e815-4c80-82c6-22ca98714e3e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lazy-loading 'flavor' on Instance uuid c1c7c4d6-0505-46bf-8130-cce01c53b0a1 {{(pid=117201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 16:32:11.496037 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-1c609abf-e815-4c80-82c6-22ca98714e3e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "POST /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1/action" status: 202 len: 0 microversion: 2.1 time: 0.128900 Apr 12 16:32:11.496762 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 644/1292] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:32:11 2022] POST /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:32:11.507924 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: ERROR oslo.messaging._drivers.impl_rabbit [-] [568855ed-b071-4c22-952c-425c5bd03630] AMQP server on 10.222.0.67:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 12 16:32:11.512288 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-82160441-859a-41fa-852d-0f367d218e74 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:11.512988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-82160441-859a-41fa-852d-0f367d218e74 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:11.522206 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-82160441-859a-41fa-852d-0f367d218e74 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:11.522664 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-82160441-859a-41fa-852d-0f367d218e74 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:11.524807 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-82160441-859a-41fa-852d-0f367d218e74 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:11.525256 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-82160441-859a-41fa-852d-0f367d218e74 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:11.668008 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-82160441-859a-41fa-852d-0f367d218e74 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:11.677360 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-82160441-859a-41fa-852d-0f367d218e74 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.173694 Apr 12 16:32:11.677946 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 649/1293] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:11 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:12.697218 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3d14ec53-2745-4b2a-a5e1-9c4f48ff5256 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:12.697896 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3d14ec53-2745-4b2a-a5e1-9c4f48ff5256 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:12.704865 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3d14ec53-2745-4b2a-a5e1-9c4f48ff5256 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:12.705311 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3d14ec53-2745-4b2a-a5e1-9c4f48ff5256 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:12.706127 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3d14ec53-2745-4b2a-a5e1-9c4f48ff5256 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:12.706566 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3d14ec53-2745-4b2a-a5e1-9c4f48ff5256 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:12.851650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3d14ec53-2745-4b2a-a5e1-9c4f48ff5256 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:12.859435 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3d14ec53-2745-4b2a-a5e1-9c4f48ff5256 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.167201 Apr 12 16:32:12.860026 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 645/1294] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:12 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:13.878736 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-553a1872-03fd-4b35-8e9a-458e9a7640ac tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:13.879635 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-553a1872-03fd-4b35-8e9a-458e9a7640ac tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:13.887966 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-553a1872-03fd-4b35-8e9a-458e9a7640ac tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:13.888393 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-553a1872-03fd-4b35-8e9a-458e9a7640ac tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:13.889179 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-553a1872-03fd-4b35-8e9a-458e9a7640ac tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:13.889620 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-553a1872-03fd-4b35-8e9a-458e9a7640ac tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:13.896172 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO oslo.messaging._drivers.impl_rabbit [-] [568855ed-b071-4c22-952c-425c5bd03630] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 53866. Apr 12 16:32:14.037611 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-553a1872-03fd-4b35-8e9a-458e9a7640ac tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:14.045988 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-553a1872-03fd-4b35-8e9a-458e9a7640ac tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.172424 Apr 12 16:32:14.046624 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 650/1295] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:13 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:15.063919 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-d8b5c3cc-9a63-431f-afdd-35a04234f283 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:15.064545 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-d8b5c3cc-9a63-431f-afdd-35a04234f283 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:15.071397 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d8b5c3cc-9a63-431f-afdd-35a04234f283 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:15.071822 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d8b5c3cc-9a63-431f-afdd-35a04234f283 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:15.072609 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d8b5c3cc-9a63-431f-afdd-35a04234f283 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:15.073041 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-d8b5c3cc-9a63-431f-afdd-35a04234f283 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:15.216540 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-d8b5c3cc-9a63-431f-afdd-35a04234f283 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:15.225385 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-d8b5c3cc-9a63-431f-afdd-35a04234f283 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.165815 Apr 12 16:32:15.225976 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 646/1296] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:15 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:16.246880 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d600ce87-3cb7-4f68-9f8b-7efdf8c95959 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:16.247829 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d600ce87-3cb7-4f68-9f8b-7efdf8c95959 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:16.255018 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d600ce87-3cb7-4f68-9f8b-7efdf8c95959 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:16.255473 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d600ce87-3cb7-4f68-9f8b-7efdf8c95959 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:16.256280 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d600ce87-3cb7-4f68-9f8b-7efdf8c95959 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:16.256719 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d600ce87-3cb7-4f68-9f8b-7efdf8c95959 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:16.414624 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d600ce87-3cb7-4f68-9f8b-7efdf8c95959 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:16.423477 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d600ce87-3cb7-4f68-9f8b-7efdf8c95959 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.181525 Apr 12 16:32:16.424073 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 651/1297] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:16 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:17.441374 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-2cd39b06-6f84-46f2-8841-14a8ca551640 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:17.441959 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-2cd39b06-6f84-46f2-8841-14a8ca551640 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:17.448757 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2cd39b06-6f84-46f2-8841-14a8ca551640 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:17.449198 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2cd39b06-6f84-46f2-8841-14a8ca551640 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:17.449979 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2cd39b06-6f84-46f2-8841-14a8ca551640 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:17.450490 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-2cd39b06-6f84-46f2-8841-14a8ca551640 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:17.596260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-2cd39b06-6f84-46f2-8841-14a8ca551640 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:17.605389 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-2cd39b06-6f84-46f2-8841-14a8ca551640 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.168215 Apr 12 16:32:17.605944 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 647/1298] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:17 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:18.623493 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-43be11ba-a4a1-4474-8a81-ad0c9361b3dc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:18.624146 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-43be11ba-a4a1-4474-8a81-ad0c9361b3dc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:18.630954 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-43be11ba-a4a1-4474-8a81-ad0c9361b3dc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:18.631384 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-43be11ba-a4a1-4474-8a81-ad0c9361b3dc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:18.632204 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-43be11ba-a4a1-4474-8a81-ad0c9361b3dc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:18.632640 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-43be11ba-a4a1-4474-8a81-ad0c9361b3dc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:18.774906 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-43be11ba-a4a1-4474-8a81-ad0c9361b3dc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:18.783573 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-43be11ba-a4a1-4474-8a81-ad0c9361b3dc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.164004 Apr 12 16:32:18.784162 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 652/1299] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:18 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:19.801349 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-329f7574-788b-4bc5-b2ff-e1c56390383c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:19.801996 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-329f7574-788b-4bc5-b2ff-e1c56390383c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:19.808396 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-329f7574-788b-4bc5-b2ff-e1c56390383c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:19.808837 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-329f7574-788b-4bc5-b2ff-e1c56390383c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:19.813434 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-329f7574-788b-4bc5-b2ff-e1c56390383c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:19.813434 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-329f7574-788b-4bc5-b2ff-e1c56390383c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:19.949416 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-329f7574-788b-4bc5-b2ff-e1c56390383c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:19.957415 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-329f7574-788b-4bc5-b2ff-e1c56390383c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.160720 Apr 12 16:32:19.958020 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 648/1300] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:19 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:20.977301 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-ef4e4789-1777-463b-a22e-c7b02490b8f5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:20.978467 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-ef4e4789-1777-463b-a22e-c7b02490b8f5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:20.986305 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ef4e4789-1777-463b-a22e-c7b02490b8f5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:20.986761 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ef4e4789-1777-463b-a22e-c7b02490b8f5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:20.987548 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ef4e4789-1777-463b-a22e-c7b02490b8f5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:20.987960 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-ef4e4789-1777-463b-a22e-c7b02490b8f5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:21.130962 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-ef4e4789-1777-463b-a22e-c7b02490b8f5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:21.138940 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-ef4e4789-1777-463b-a22e-c7b02490b8f5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.168430 Apr 12 16:32:21.139536 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 653/1301] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:20 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:22.157165 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-4d785b7c-3a21-46b5-8ddf-3fadb21b3e3b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:22.158006 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-4d785b7c-3a21-46b5-8ddf-3fadb21b3e3b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:22.165021 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4d785b7c-3a21-46b5-8ddf-3fadb21b3e3b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:22.165714 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4d785b7c-3a21-46b5-8ddf-3fadb21b3e3b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:22.166497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4d785b7c-3a21-46b5-8ddf-3fadb21b3e3b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:22.166803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-4d785b7c-3a21-46b5-8ddf-3fadb21b3e3b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:22.321210 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-4d785b7c-3a21-46b5-8ddf-3fadb21b3e3b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:22.329344 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-4d785b7c-3a21-46b5-8ddf-3fadb21b3e3b tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.176547 Apr 12 16:32:22.329909 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 649/1302] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:22 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:23.347308 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-07a72f26-d956-4d9b-977c-2ddfa6e13d40 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:23.347928 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-07a72f26-d956-4d9b-977c-2ddfa6e13d40 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:23.360086 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07a72f26-d956-4d9b-977c-2ddfa6e13d40 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:23.360879 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07a72f26-d956-4d9b-977c-2ddfa6e13d40 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:23.362324 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07a72f26-d956-4d9b-977c-2ddfa6e13d40 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:23.363089 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-07a72f26-d956-4d9b-977c-2ddfa6e13d40 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:23.501111 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-07a72f26-d956-4d9b-977c-2ddfa6e13d40 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:23.510394 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-07a72f26-d956-4d9b-977c-2ddfa6e13d40 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.166901 Apr 12 16:32:23.511011 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 654/1303] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:23 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:24.528494 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-5d01c0ac-3537-4b9c-a79c-e186bddf6807 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:24.529099 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-5d01c0ac-3537-4b9c-a79c-e186bddf6807 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:24.537015 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5d01c0ac-3537-4b9c-a79c-e186bddf6807 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:24.537493 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5d01c0ac-3537-4b9c-a79c-e186bddf6807 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:24.538315 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5d01c0ac-3537-4b9c-a79c-e186bddf6807 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:24.538742 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-5d01c0ac-3537-4b9c-a79c-e186bddf6807 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:24.683775 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-5d01c0ac-3537-4b9c-a79c-e186bddf6807 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:24.692682 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-5d01c0ac-3537-4b9c-a79c-e186bddf6807 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.167966 Apr 12 16:32:24.693176 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 650/1304] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:24 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:25.713726 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-a324fcf7-f60c-46a3-b429-8f93385e6c41 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:25.714742 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-a324fcf7-f60c-46a3-b429-8f93385e6c41 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:25.723163 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a324fcf7-f60c-46a3-b429-8f93385e6c41 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:25.723614 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a324fcf7-f60c-46a3-b429-8f93385e6c41 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:25.724428 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a324fcf7-f60c-46a3-b429-8f93385e6c41 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:25.724871 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-a324fcf7-f60c-46a3-b429-8f93385e6c41 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:25.864039 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-a324fcf7-f60c-46a3-b429-8f93385e6c41 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:25.872720 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-a324fcf7-f60c-46a3-b429-8f93385e6c41 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1508 microversion: 2.1 time: 0.164848 Apr 12 16:32:25.873311 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 655/1305] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:25 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:25.890024 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-6f89dc97-87d7-45ee-aa7b-d8e3178192c4 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:32:25.890708 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-6f89dc97-87d7-45ee-aa7b-d8e3178192c4 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:25.897594 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6f89dc97-87d7-45ee-aa7b-d8e3178192c4 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:25.898140 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6f89dc97-87d7-45ee-aa7b-d8e3178192c4 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:25.898856 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6f89dc97-87d7-45ee-aa7b-d8e3178192c4 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:25.899296 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-6f89dc97-87d7-45ee-aa7b-d8e3178192c4 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:25.980374 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-6f89dc97-87d7-45ee-aa7b-d8e3178192c4 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "POST /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1/action" status: 202 len: 0 microversion: 2.1 time: 0.094249 Apr 12 16:32:25.981002 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 651/1306] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Apr 12 16:32:25 2022] POST /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:32:25.989626 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c51b33b1-2ba5-48b8-b78e-011f6319359e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:25.990383 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c51b33b1-2ba5-48b8-b78e-011f6319359e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:25.997174 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c51b33b1-2ba5-48b8-b78e-011f6319359e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:25.997603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c51b33b1-2ba5-48b8-b78e-011f6319359e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:25.998438 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c51b33b1-2ba5-48b8-b78e-011f6319359e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:25.998854 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c51b33b1-2ba5-48b8-b78e-011f6319359e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:26.148701 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c51b33b1-2ba5-48b8-b78e-011f6319359e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:26.157273 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c51b33b1-2ba5-48b8-b78e-011f6319359e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1516 microversion: 2.1 time: 0.171652 Apr 12 16:32:26.162125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 656/1307] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:25 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:26.209405 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-5ade2c91-b04a-416e-89d7-db9e78590371 req-4558d949-286e-4d2d-892d-2df1ef25045f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c7c4d6-0505-46bf-8130-cce01c53b0a1", "name": "network-vif-unplugged", "status": "completed", "tag": "eaa5fff0-49ae-403f-aee0-ecb06b0f8df9"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:32:26.221119 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-5ade2c91-b04a-416e-89d7-db9e78590371 req-4558d949-286e-4d2d-892d-2df1ef25045f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:26.221816 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-5ade2c91-b04a-416e-89d7-db9e78590371 req-4558d949-286e-4d2d-892d-2df1ef25045f service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:26.235897 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.compute.server_external_events [req-5ade2c91-b04a-416e-89d7-db9e78590371 req-4558d949-286e-4d2d-892d-2df1ef25045f service nova] Unable to find a host for instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1. Dropping event network-vif-unplugged {{(pid=117201) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 12 16:32:26.237116 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-5ade2c91-b04a-416e-89d7-db9e78590371 req-4558d949-286e-4d2d-892d-2df1ef25045f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031620 Apr 12 16:32:26.237860 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 652/1308] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 12 16:32:27.175078 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-65f8298f-f7bf-4dcc-b7a2-b3e0102b9650 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:27.175773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-65f8298f-f7bf-4dcc-b7a2-b3e0102b9650 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:27.182667 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65f8298f-f7bf-4dcc-b7a2-b3e0102b9650 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:27.183123 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65f8298f-f7bf-4dcc-b7a2-b3e0102b9650 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:27.184099 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65f8298f-f7bf-4dcc-b7a2-b3e0102b9650 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:27.184864 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-65f8298f-f7bf-4dcc-b7a2-b3e0102b9650 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:27.340007 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-65f8298f-f7bf-4dcc-b7a2-b3e0102b9650 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:27.348365 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-65f8298f-f7bf-4dcc-b7a2-b3e0102b9650 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1518 microversion: 2.1 time: 0.177263 Apr 12 16:32:27.348832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 657/1309] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:27 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:28.366374 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-0f9e9cf6-b7dc-4a36-b3a9-e31a0d474f2c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:28.367000 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-0f9e9cf6-b7dc-4a36-b3a9-e31a0d474f2c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:28.374448 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0f9e9cf6-b7dc-4a36-b3a9-e31a0d474f2c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:28.375022 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0f9e9cf6-b7dc-4a36-b3a9-e31a0d474f2c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:28.375825 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0f9e9cf6-b7dc-4a36-b3a9-e31a0d474f2c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:28.376265 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-0f9e9cf6-b7dc-4a36-b3a9-e31a0d474f2c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:28.520681 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-0f9e9cf6-b7dc-4a36-b3a9-e31a0d474f2c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:28.528640 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-0f9e9cf6-b7dc-4a36-b3a9-e31a0d474f2c tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.166445 Apr 12 16:32:28.529184 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 653/1310] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:28 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:29.546225 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c518d1bf-92e1-43e2-a4d7-f6996da55299 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:29.547017 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c518d1bf-92e1-43e2-a4d7-f6996da55299 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:29.554227 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c518d1bf-92e1-43e2-a4d7-f6996da55299 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:29.554678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c518d1bf-92e1-43e2-a4d7-f6996da55299 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:29.555457 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c518d1bf-92e1-43e2-a4d7-f6996da55299 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:29.555885 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c518d1bf-92e1-43e2-a4d7-f6996da55299 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:29.698271 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c518d1bf-92e1-43e2-a4d7-f6996da55299 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:29.708142 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c518d1bf-92e1-43e2-a4d7-f6996da55299 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.165864 Apr 12 16:32:29.708767 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 658/1311] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:29 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:30.727260 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-bb2d1ecb-bf6b-4b6b-aee0-3fed7b9744d2 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:30.727956 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-bb2d1ecb-bf6b-4b6b-aee0-3fed7b9744d2 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:30.735262 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bb2d1ecb-bf6b-4b6b-aee0-3fed7b9744d2 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:30.735712 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bb2d1ecb-bf6b-4b6b-aee0-3fed7b9744d2 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:30.736497 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bb2d1ecb-bf6b-4b6b-aee0-3fed7b9744d2 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:30.736931 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-bb2d1ecb-bf6b-4b6b-aee0-3fed7b9744d2 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:30.878905 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-bb2d1ecb-bf6b-4b6b-aee0-3fed7b9744d2 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:30.889660 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-bb2d1ecb-bf6b-4b6b-aee0-3fed7b9744d2 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.166352 Apr 12 16:32:30.890363 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 654/1312] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:30 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:31.907281 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-efc4d490-fdac-4887-92b2-d265977ff750 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:31.907925 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-efc4d490-fdac-4887-92b2-d265977ff750 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:31.914847 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-efc4d490-fdac-4887-92b2-d265977ff750 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:31.915294 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-efc4d490-fdac-4887-92b2-d265977ff750 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:31.916064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-efc4d490-fdac-4887-92b2-d265977ff750 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:31.916524 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-efc4d490-fdac-4887-92b2-d265977ff750 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:32.057037 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-efc4d490-fdac-4887-92b2-d265977ff750 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:32.065960 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-efc4d490-fdac-4887-92b2-d265977ff750 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.162481 Apr 12 16:32:32.066603 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 659/1313] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:31 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:33.083551 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3833f7f7-98d6-45e7-a487-7debb835610d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:33.084175 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3833f7f7-98d6-45e7-a487-7debb835610d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:33.090680 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3833f7f7-98d6-45e7-a487-7debb835610d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:33.091130 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3833f7f7-98d6-45e7-a487-7debb835610d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:33.091918 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3833f7f7-98d6-45e7-a487-7debb835610d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:33.092359 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3833f7f7-98d6-45e7-a487-7debb835610d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:33.228324 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3833f7f7-98d6-45e7-a487-7debb835610d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:33.236310 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3833f7f7-98d6-45e7-a487-7debb835610d tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.156825 Apr 12 16:32:33.236880 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 655/1314] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:33 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:34.253759 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-db93b9ed-1554-4b40-9b88-8d1bf100f022 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:34.254408 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-db93b9ed-1554-4b40-9b88-8d1bf100f022 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:34.261122 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db93b9ed-1554-4b40-9b88-8d1bf100f022 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:34.261576 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db93b9ed-1554-4b40-9b88-8d1bf100f022 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:34.262390 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db93b9ed-1554-4b40-9b88-8d1bf100f022 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:34.262826 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-db93b9ed-1554-4b40-9b88-8d1bf100f022 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:34.398616 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-db93b9ed-1554-4b40-9b88-8d1bf100f022 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:34.406479 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-db93b9ed-1554-4b40-9b88-8d1bf100f022 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.156639 Apr 12 16:32:34.407057 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 660/1315] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:34 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:35.424388 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-b7388d05-bd8e-4319-9747-37c2e7bfab9e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:35.424969 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-b7388d05-bd8e-4319-9747-37c2e7bfab9e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:35.432086 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7388d05-bd8e-4319-9747-37c2e7bfab9e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:35.432534 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7388d05-bd8e-4319-9747-37c2e7bfab9e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:35.433314 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7388d05-bd8e-4319-9747-37c2e7bfab9e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:35.433771 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-b7388d05-bd8e-4319-9747-37c2e7bfab9e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:35.595527 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-b7388d05-bd8e-4319-9747-37c2e7bfab9e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:35.605054 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-b7388d05-bd8e-4319-9747-37c2e7bfab9e tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.184902 Apr 12 16:32:35.605648 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 656/1316] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:35 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:36.623019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-09210f8d-8182-4f3c-88ff-f5a778d88c37 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:36.624143 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-09210f8d-8182-4f3c-88ff-f5a778d88c37 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:36.631147 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09210f8d-8182-4f3c-88ff-f5a778d88c37 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:36.631686 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09210f8d-8182-4f3c-88ff-f5a778d88c37 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:36.632547 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09210f8d-8182-4f3c-88ff-f5a778d88c37 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:36.633046 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-09210f8d-8182-4f3c-88ff-f5a778d88c37 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:36.773165 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-09210f8d-8182-4f3c-88ff-f5a778d88c37 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:36.780832 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-09210f8d-8182-4f3c-88ff-f5a778d88c37 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.161643 Apr 12 16:32:36.790961 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 661/1317] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:36 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:37.800646 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-a02a317e-3364-4bb0-a206-48b17fb400f3 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:37.801713 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-a02a317e-3364-4bb0-a206-48b17fb400f3 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:37.810935 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a02a317e-3364-4bb0-a206-48b17fb400f3 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:37.811602 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a02a317e-3364-4bb0-a206-48b17fb400f3 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:37.812592 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a02a317e-3364-4bb0-a206-48b17fb400f3 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:37.813013 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-a02a317e-3364-4bb0-a206-48b17fb400f3 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:37.957081 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-a02a317e-3364-4bb0-a206-48b17fb400f3 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:37.969694 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-a02a317e-3364-4bb0-a206-48b17fb400f3 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.174928 Apr 12 16:32:37.970318 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 657/1318] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:37 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:38.301022 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [req-e60fb466-2d14-4f3d-9274-d93133b86bad req-0d0cdc9f-607c-491b-8f4b-f98c4f838076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c7c4d6-0505-46bf-8130-cce01c53b0a1", "name": "network-vif-plugged", "status": "completed", "tag": "eaa5fff0-49ae-403f-aee0-ecb06b0f8df9"}]} {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:32:38.310000 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-e60fb466-2d14-4f3d-9274-d93133b86bad req-0d0cdc9f-607c-491b-8f4b-f98c4f838076 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:38.310430 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [req-e60fb466-2d14-4f3d-9274-d93133b86bad req-0d0cdc9f-607c-491b-8f4b-f98c4f838076 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:38.323766 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.compute.server_external_events [req-e60fb466-2d14-4f3d-9274-d93133b86bad req-0d0cdc9f-607c-491b-8f4b-f98c4f838076 service nova] Creating event network-vif-plugged:eaa5fff0-49ae-403f-aee0-ecb06b0f8df9 for instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1 on hv-cinder-83752 Apr 12 16:32:38.329400 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [req-e60fb466-2d14-4f3d-9274-d93133b86bad req-0d0cdc9f-607c-491b-8f4b-f98c4f838076 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 Apr 12 16:32:38.330064 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 662/1319] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:32:38.987677 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-743d97f9-8ad6-4e83-af6c-09d9cdcfbe73 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:38.988249 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-743d97f9-8ad6-4e83-af6c-09d9cdcfbe73 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:38.994973 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-743d97f9-8ad6-4e83-af6c-09d9cdcfbe73 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:38.995430 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-743d97f9-8ad6-4e83-af6c-09d9cdcfbe73 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:38.996205 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-743d97f9-8ad6-4e83-af6c-09d9cdcfbe73 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:38.996635 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-743d97f9-8ad6-4e83-af6c-09d9cdcfbe73 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:39.142146 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-743d97f9-8ad6-4e83-af6c-09d9cdcfbe73 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:39.150364 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-743d97f9-8ad6-4e83-af6c-09d9cdcfbe73 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.166640 Apr 12 16:32:39.150956 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 658/1320] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:38 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:32:40.169497 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-c780671f-e313-45d2-a1cf-115e1c228b10 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:40.170309 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-c780671f-e313-45d2-a1cf-115e1c228b10 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:40.177042 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c780671f-e313-45d2-a1cf-115e1c228b10 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:40.177498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c780671f-e313-45d2-a1cf-115e1c228b10 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:40.178320 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c780671f-e313-45d2-a1cf-115e1c228b10 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:40.178764 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-c780671f-e313-45d2-a1cf-115e1c228b10 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:40.324161 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-c780671f-e313-45d2-a1cf-115e1c228b10 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:40.334787 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-c780671f-e313-45d2-a1cf-115e1c228b10 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1574 microversion: 2.1 time: 0.169988 Apr 12 16:32:40.335403 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 663/1321] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:40 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:32:41.352956 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-93657c46-64e1-410e-a992-a4d17cb4f8d8 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:41.353581 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-93657c46-64e1-410e-a992-a4d17cb4f8d8 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:32:41.360923 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93657c46-64e1-410e-a992-a4d17cb4f8d8 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:41.361367 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93657c46-64e1-410e-a992-a4d17cb4f8d8 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:41.362198 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93657c46-64e1-410e-a992-a4d17cb4f8d8 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:32:41.362631 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-93657c46-64e1-410e-a992-a4d17cb4f8d8 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:32:41.492258 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-93657c46-64e1-410e-a992-a4d17cb4f8d8 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:32:41.500219 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-93657c46-64e1-410e-a992-a4d17cb4f8d8 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1561 microversion: 2.1 time: 0.151548 Apr 12 16:32:41.500796 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 659/1322] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:32:41 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:33:34.951696 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:33:34.952344 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: Tue Apr 12 16:33:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:33:58.832463 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-4434b337-717a-466d-91fb-bc7560560efb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:33:58.833117 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4434b337-717a-466d-91fb-bc7560560efb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:33:58.834861 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-435c3f63-9f4d-4c0f-a273-fda751b02827 req-336365a8-5de7-4216-ad27-a2893c4d25e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c7c4d6-0505-46bf-8130-cce01c53b0a1", "tag": "eaa5fff0-49ae-403f-aee0-ecb06b0f8df9"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:33:58.845559 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-435c3f63-9f4d-4c0f-a273-fda751b02827 req-336365a8-5de7-4216-ad27-a2893c4d25e2 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:33:58.846650 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-435c3f63-9f4d-4c0f-a273-fda751b02827 req-336365a8-5de7-4216-ad27-a2893c4d25e2 service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:33:58.852979 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4434b337-717a-466d-91fb-bc7560560efb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:33:58.853578 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4434b337-717a-466d-91fb-bc7560560efb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:33:58.854476 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4434b337-717a-466d-91fb-bc7560560efb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:33:58.854933 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-4434b337-717a-466d-91fb-bc7560560efb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:33:58.859457 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-435c3f63-9f4d-4c0f-a273-fda751b02827 req-336365a8-5de7-4216-ad27-a2893c4d25e2 service nova] Creating event network-changed:eaa5fff0-49ae-403f-aee0-ecb06b0f8df9 for instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1 on hv-cinder-83752 Apr 12 16:33:58.866636 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-435c3f63-9f4d-4c0f-a273-fda751b02827 req-336365a8-5de7-4216-ad27-a2893c4d25e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036567 Apr 12 16:33:58.867438 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 660/1323] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:33:58.889125 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-4434b337-717a-466d-91fb-bc7560560efb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Going to try to terminate instance {{(pid=117202) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 16:33:58.973621 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-4434b337-717a-466d-91fb-bc7560560efb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 204 len: 0 microversion: 2.1 time: 0.145811 Apr 12 16:33:58.977525 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 664/1324] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Apr 12 16:33:58 2022] DELETE /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:33:58.984803 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-3f6f91ce-2e5a-433b-8151-7c2071c5969a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:33:58.985507 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-3f6f91ce-2e5a-433b-8151-7c2071c5969a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:33:58.992053 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3f6f91ce-2e5a-433b-8151-7c2071c5969a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:33:58.992498 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3f6f91ce-2e5a-433b-8151-7c2071c5969a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:33:58.993437 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3f6f91ce-2e5a-433b-8151-7c2071c5969a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:33:58.993951 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-3f6f91ce-2e5a-433b-8151-7c2071c5969a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:33:59.133602 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.policy [None req-3f6f91ce-2e5a-433b-8151-7c2071c5969a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117201) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:33:59.142274 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-3f6f91ce-2e5a-433b-8151-7c2071c5969a tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.162657 Apr 12 16:33:59.142894 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 661/1325] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:33:58 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:34:00.162019 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-0dac373f-5f7d-4cdd-a27a-1ff43a760ccd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:34:00.162743 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-0dac373f-5f7d-4cdd-a27a-1ff43a760ccd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:34:00.170273 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0dac373f-5f7d-4cdd-a27a-1ff43a760ccd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:34:00.170744 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0dac373f-5f7d-4cdd-a27a-1ff43a760ccd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:34:00.171498 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0dac373f-5f7d-4cdd-a27a-1ff43a760ccd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:34:00.171925 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-0dac373f-5f7d-4cdd-a27a-1ff43a760ccd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:34:00.308353 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-0dac373f-5f7d-4cdd-a27a-1ff43a760ccd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:34:00.316727 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-0dac373f-5f7d-4cdd-a27a-1ff43a760ccd tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1567 microversion: 2.1 time: 0.158859 Apr 12 16:34:00.317350 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 665/1326] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:34:00 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:34:01.332346 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [req-718d8ed3-cdee-4992-b8dd-7e1b78f0e2e3 req-dc22537d-e6de-4b2a-a213-b9d97af679fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c7c4d6-0505-46bf-8130-cce01c53b0a1", "name": "network-vif-deleted", "tag": "eaa5fff0-49ae-403f-aee0-ecb06b0f8df9"}]} {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:34:01.334891 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-d25263cb-8c74-4d95-8388-5013535ad3eb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:34:01.335611 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.compute.api [None req-d25263cb-8c74-4d95-8388-5013535ad3eb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117202) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:34:01.342126 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d25263cb-8c74-4d95-8388-5013535ad3eb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:34:01.342490 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d25263cb-8c74-4d95-8388-5013535ad3eb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:34:01.343322 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d25263cb-8c74-4d95-8388-5013535ad3eb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:34:01.343714 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-718d8ed3-cdee-4992-b8dd-7e1b78f0e2e3 req-dc22537d-e6de-4b2a-a213-b9d97af679fb service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:34:01.343878 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG oslo_concurrency.lockutils [None req-d25263cb-8c74-4d95-8388-5013535ad3eb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117202) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:34:01.344503 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [req-718d8ed3-cdee-4992-b8dd-7e1b78f0e2e3 req-dc22537d-e6de-4b2a-a213-b9d97af679fb service nova] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:34:01.359165 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.compute.server_external_events [req-718d8ed3-cdee-4992-b8dd-7e1b78f0e2e3 req-dc22537d-e6de-4b2a-a213-b9d97af679fb service nova] Creating event network-vif-deleted:eaa5fff0-49ae-403f-aee0-ecb06b0f8df9 for instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1 on hv-cinder-83752 Apr 12 16:34:01.366454 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [req-718d8ed3-cdee-4992-b8dd-7e1b78f0e2e3 req-dc22537d-e6de-4b2a-a213-b9d97af679fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037882 Apr 12 16:34:01.367061 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 662/1327] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Apr 12 16:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:34:01.407773 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.policy [None req-d25263cb-8c74-4d95-8388-5013535ad3eb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57243ae715c428a91234a8eadfff473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f38a4892a04f7d98a6c1b1c1dfbd89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117202) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 16:34:01.415936 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-d25263cb-8c74-4d95-8388-5013535ad3eb tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 200 len: 1382 microversion: 2.1 time: 0.084929 Apr 12 16:34:01.416520 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 666/1328] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:34:01 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 1382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:34:02.435170 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '>' {{(pid=117201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:34:02.435915 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.compute.api [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] [instance: c1c7c4d6-0505-46bf-8130-cce01c53b0a1] Fetching instance by UUID {{(pid=117201) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 16:34:02.442608 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:34:02.443077 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:34:02.443980 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 16:34:02.444717 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG oslo_concurrency.lockutils [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Lock "a95edbfc-1ac9-4e2d-aad7-de147f566f45" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 16:34:02.460143 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.wsgi [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] HTTP exception thrown: Instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1 could not be found. Apr 12 16:34:02.460744 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: DEBUG nova.api.openstack.wsgi [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Returning 404 to user: Instance c1c7c4d6-0505-46bf-8130-cce01c53b0a1 could not be found. {{(pid=117201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 16:34:02.461586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO nova.api.openstack.requestlog [None req-eeaabb07-c18d-45f3-a716-53acbb8f5abc tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1" status: 404 len: 111 microversion: 2.1 time: 0.032015 Apr 12 16:34:02.462264 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: [pid: 117201|app: 0|req: 663/1329] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Apr 12 16:34:02 2022] GET /compute/v2.1/servers/c1c7c4d6-0505-46bf-8130-cce01c53b0a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:34:02.629695 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: DEBUG nova.api.openstack.wsgi [None req-66f64bb0-bb85-4204-8c4b-e412eaac2dd5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] Calling method '.version_select at 0x7f246d9d1f70>' {{(pid=117202) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:34:02.652678 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO nova.api.openstack.requestlog [None req-66f64bb0-bb85-4204-8c4b-e412eaac2dd5 tempest-TestShelveInstance-766900467 tempest-TestShelveInstance-766900467-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1463700145" status: 202 len: 0 microversion: 2.1 time: 0.026878 Apr 12 16:34:02.653262 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: [pid: 117202|app: 0|req: 667/1330] 10.222.0.67 () {58 vars in 1253 bytes} [Tue Apr 12 16:34:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1463700145 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:35:22.809068 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:35:22.809711 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: Tue Apr 12 16:35:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:35:30.831942 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:35:30.833045 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: Tue Apr 12 16:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:36:54.960782 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:36:54.961324 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: Tue Apr 12 16:36:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:37:07.988783 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:37:07.989566 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: Tue Apr 12 16:37:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:37:15.880424 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:37:15.881131 dv-cinder-837528-1-iscsi devstack@n-api.service[117202]: Tue Apr 12 16:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:38:42.817662 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:38:42.818360 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: Tue Apr 12 16:38:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:38:50.841506 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:38:50.842586 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: Tue Apr 12 16:38:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 16:39:05.646255 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:39:05.646941 dv-cinder-837528-1-iscsi devstack@n-api.service[117201]: Tue Apr 12 16:39:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!